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Introduction to 
Computers, Internet and 
World Wide Web 


E) 


Objectives 

• To understand basic computer concepts. 

• To become familiar with different types of 
programming languages. 

• To become familiar with the history of the Python 
programming language. 

• To preview the remaining chapters of the book. 
Things are always at their best in their beginning. 

Blaise Pascal 

High thoughts must have high language. 

Aristophanes 

Our life is frittered away by detail...Simplify, simplify. 
Henry David Thoreau 
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1.1 Introduction 

Welcome to Python! We have worked hard to create what we hope will be an informative 
and entertaining learning experience for you. The manner in which we approached this top- 
ic created a book that is unique among Python textbooks for many reasons. For instance, 
we introduce early in the text the use of Python with the Conunon Gateway Interface (CGI) 
for programming Web-based applications. We do this so that we can demonstrate a variety 
of dynamic, Web-based applications in the remainder of the book. This text also introduces 
a range of topics, including object-orientedprogramming (OOP), the Python database ap¬ 
plicatiori programming interface (DB-API), graphics, the Extensible Markup Language 
(XML), security and an appendix on Web accessibility that addresses programming and 
technologies relevant to people with impairments. Whether you are a novice or an experi- 
enced programmer, there is much here to inform, entertain and challenge you. 

Python How to Program is designed to be appropriate for readers at all levels, from 
practicing programmers to individuals with little or no programming experience. How can 
one book appeal to both novices and skilled programmers? The core of this book empha- 
sizes achieving program clarity through proven techniques of structuredprogramming and 
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object-based programming. Nonprogrammers leam basic skills that underlie good pro- 
gramming; experienced programmers receive a rigorous explanation of the language and 
may improve their programming styles. To aid beginning programmers, we have written 
this text in a ciear and straightforward manner, with abundant illustrations. Perhaps most 
importantly, the book presents hundreds of complete working Python programs and shows 
the outputs produced when those programs are run on a computer. We call this our Live- 
Code™ approcich. All of the book’s examples are available on the CD-ROM that accom- 
panies this book and on our Web site, www. deitel. com. 

Most people are at least somewhat familiar with the exciting capabilities of computers. 
Using this textbook, you will learn how to command computers to exercise those capabil¬ 
ities. It is Software (i.e., the instructions you write to command the computer to perform 
actions and make decisions) that Controls computers (often referred to as Hardware ). 

Computer use is increasing in almost every field. In an era of steadily rising costs, the 
expense of owning a computer has been decreasing dramatically due to rapid developments 
in both hardware and Software technology. Computers that filled large rooms and cost mil- 
lions of dollars 25 to 30 years ago now are inscribed on the surfaces of Silicon chips smaller 
than a fingernail and that cost perhaps a few dollars each. Silicon is one of the most abun¬ 
dant materials on the earth—it is an ingredient in common sand. Silicon-chip technology 
has made computing so economical that hundreds of millions of general-purpose com¬ 
puters are in use worldwide, helping people in business, industry, government and their per- 
sonal lives. Given the current rate of technological development, this number could easily 
double over the next few years. 

In beginning to study this text, you are starting on a challenging and rewarding educa- 
tional path. As you proceed, if you would like to communicate with us, please send us e-mail 
at deitel@deitel.com or browse our World Wide Web sites at www.deitel. com, 
www.prenhall.com/deitel and www.InformIT.com/deitel. We hope you 
enjoy learning Python with Python How to Program. 

1.2 What Is a Computer? 

A computer is a device capable of performing computations and making logical decisions at 
speeds millions and even billions of times faster than those of human beings. For example, 
many of today’s personal computers can perform hundreds of millions—even billions—of 
additions per second. A person operating a desk calculator might require decades to com¬ 
plete the same number of calculations that a powerful personal computer can perform in one 
second. ( Points toponder: How would you know whether the person added the numbers cor- 
rectly? How would you know whether the computer added the numbers correctly?) Today’ s 
fastest supercomputers can perform hundreds of billions of additions per second—about as 
many calculations as hundreds of thousands of people could perform in one year! Trillion- 
instruction-per-second computers are already functioning in research laboratories! 

Computers process data under the control of sets of instructions called computer pro¬ 
grams. These programs guide computers through orderly sets of actions that are specified 
by individuals known as computer programmers. 

A computer is composed of various de vices (such as the keyboard, screen, mouse, disks, 
memory, CD-ROM and processing units) known as hardware. The programs that run on a 
computer are referred to as Software. Hardware costs have been declining dramatically in 
recent years, to the point that personal computers have become a commodity. Software-devel- 
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opment costs, however, have been rising steadily, as programmers develop ever more pow- 
erful and complex applications without being able to improve significantly the technology of 
Software development. In this book, you will learn proven software-development methods 
that can reduce software-development costs—top-down, stepwise refinement, functionaliza- 
tion and object-oriented programming. Object-Oriented programming is widely believed to be 
the significant breakthrough that can greatly enhance programmer productivity. 

1.3 ComputerOiganization 

Virtually every computer, regardless of differences in physical appearance, can be envi- 
sioned as being divided into six logical units, or sections: 

1. Input unit. This “receiving” section of the computer obtains information (data and 
computer programs) from various input devices. The input unit then places this in¬ 
formation at the disposal of the other units to facilitate the processing of the infor¬ 
mation. Today, most users enter information into computers via keyboards and 
mouse devices. Other input devices include microphones (for speaking to the 
computer), scanners (for scanning images) and digital cameras and video cameras 
(for taking photographs and making videos). 

2. Output unit. This “shipping” section of the computer takes information that the 
computer has processed and places it on various output devices, making the infor¬ 
mation available for use outside the computer. Computers can output information 
in various ways, including displaying the output on screens, playing it on audio/ 
video devices, printing it on paper or using the output to control other devices. 

3. Memory unit. This is the rapid-access, relatively low-capacity “warehouse” sec¬ 
tion of the computer, which facilitates the temporary storage of data. The memory 
unit retains information that has been entered through the input unit, enabling that 
information to be immediately available for processing. In addition, the unit re¬ 
tains processed information until that information can be transmitted to output de¬ 
vices. Often, the memory unit is called either memory or primary memory — 
random access memory (RAM) is an example of primary memory. Primary mem¬ 
ory is usually volatile, which means that it is erased when the machine is powered 
off. 

4. Arithmetic and logic unit (ALU). The ALU is the “manufacturing” section of the 
computer. It is responsible for the performance of calculations such as addition, 
subtraction, multiplication and division. It also contains decision mechanisms, al- 
lowing the computer to perform such tasks as determining whether two items 
stored in memory are equal. 

5. Central processing unit (CPU). The CPU serves as the “administrative” section of 
the computer. This is the computer’s coordinator, responsible for supervising the 
operation of the other sections. The CPU alerts the input unit when information 
should be read into the memory unit, instructs the ALU about when to use infor¬ 
mation from the memory unit in calculations and telis the output unit when to send 
information from the memory unit to certain output devices. 

6. Secondary storage unit. This unit is the long-term, high-capacity “warehousing” 
section of the computer. Secondary storage devices, such as hard drives and disks. 





























pythonhtpl_01.fm Page 5 Monday, December 10, 2001 12:13 PM 


Chapter 1 Introduction to Computers, Internet and World Wide Web 5 


normally hold programs or data that other units are not actively using; the computer 
then can retrieve this information when it is needed—hours, days, months or even 
years later. Information in secondary storage takes much longer to access than does 
information in primary memory. However, the price per unit of secondary storage 
is much less than the price per unit of primary memory. Secondary storage is usu- 
ally nonvolatile —it retains information even when the computer is off. 

1.4 Evolution ofOperating Systems 

Early computers were capable of performing only one job or task at a time. In this mode of 
computer operation, often called single-user batch processing, the computer runs one pro- 
gram at a time and processes data in groups called batches. Users of these early systems 
typically submitted their jobs to a computer center on decks of punched cards. Often, hours 
or even days elapsed before results were returned to the users’ desks. 

To make computer use more convenient, Software systems called operating systems 
were developed. Early operating systems oversaw and managed computers’ transitions 
between jobs. By minimizing the time it took for a computer operator to switch from one 
job to another, the operating system increased the total amount of work, or throughput, 
computers could process in a given time period. 

As computers became more powerful, single-user batch processing became inefficient, 
because computers spent a great deal of time waiting for slow input/output devices to com¬ 
plete their tasks. Developers then looked to multiprogramming techniques, which enabled 
many tasks to share the resources of the computer to achieve better utilization. Multipro¬ 
gramming involves the “simultaneous” operation of many jobs on a computer that splits its 
resources among those jobs. However, users of early multiprogramming operating systems 
stili submitted jobs on decks of punched cards and waited hours or days for results. 

In the 1960s, several industry and university groups pioneered timesharing operating 
systems. Timesharing is a special type of multiprogramming that allows users to access a 
computer through terminals (devices with keyboards and screens). Dozens or even hun- 
dreds of people can use a timesharing computer system at once. It is important to note that 
the computer does not actually run ali the users’ requests simultaneously. Rather, it per- 
forms a small portion of one user’s job and moves on to Service the next user. However, 
because the computer does this so quickly, it can provide Service to each user several times 
per second. This gives users’ programs the appearance of running simultaneously. Time¬ 
sharing offers major advantages over previous computing systems in that users receive 
prompt responses to requests, instead of waiting long periods to obtain results. 

The UNIX operating system, which is now widely used for advanced computing, origi- 
nated as an experimental timesharing operating system. Dennis Ritchie and Ken Thompson 
developed UNIX at Bell Laboratories beginning in the late 1960s and developed C as the pro- 
gramming language in which they wrote it. They freely distributed the source code to other 
programmers who wanted to use, modify and extend it. A large community of UNIX users 
quickly developed. The operating system and the world of the C language grew as UNIX 
users contributed their own programs and tools. Through a collaborative effort among 
numerous researchers and developers, UNIX became a powerful and flexible operating 
system able to handle almost any type of task that a user required. Many versions of UNIX 
have evolved, including today’s phenomenally popular, open-source, Linux operating 
system. 





























pythonhtpl_01.fm Page 6 Monday, December 10, 2001 12:13 PM 


6 Introduction to Computers, Internet and World Wide Web Chapter 1 

1.5 Personal Computing, Distributed Computing and Client/ 
Server C omputing 

In 1977, Apple Computer popularized the phenomenon of personal computing. Initially, it 
was a hobbyist’s dream. However, the price of computers soon dropped so far that large 
numbers of people could buy them for personal or business use. In 1981, IBM, the world’s 
largest computer vendor, introduced the IBM Personal Computer. Personal computing rap- 
idly became legitimate in business, industry and government organizations. 

The computers first pioneered by Apple and IBM were “stand-alone” units—people did 
their work on their own machines and transported disks back and forth to share information. 
(This process was often called “sneakernet.”) Although early personal computers were not 
powerful enough to timeshare several users, the machines could be linked together into com¬ 
puter networks, either over telephone lines or via local area networks (LANs ) within an orga- 
nization. These networks led to the distributed computing phenomenon, in which an 
organization’s computing is distributed over networks to the sites at which the work of the 
organization is performed, instead of being performed only at a Central computer installation. 
Personal computers were powerful enough to handle both the computing requirements of 
individual users and the basic tasks involved in the electronic transfer of information between 
computers. N-tier applicatioris split up an application over numerous distributed computers. 
For example, a three-tier application might have a user interface on one computer, business- 
logic processing on a second and a database on a third; ali interact as the application runs. 

Today’s most advanced personal computers are as powerful as the million-dollar 
machines of just two decades ago. High-powered desktop machines—called worksta- 
tions —provide individual users with enormous capabilities. Information is easily shared 
across computer networks, in which computers called servers store programs and data that 
can be used by client computers distributed throughout the network. This type of configu- 
ration gave rise to the term client/server computing. Today’s popular operating systems, 
such as UNIX, Solaris, MacOS, Windows 2000, Windows XP and Linux, provide the kinds 
of capabilities discussed in this section. 

1.6 Machine Languages,AssemblyLanguagesand High-Level 
Languages 

Programmers write instructions in various programming languages, some directly under- 
standable by computers and others that require intermediate translation steps. Although 
hundreds of computer languages are in use today, the diverse offerings can be divided into 
three general types: 

1. Machine languages 

2. Assembly languages 

3. High-level languages 

Any computer can understand only its own machine language directly. As the “natural 
language” of a particular computer, machine language is defined by the computer’s hard- 
ware design. Machine languages generally consist of streams of numbers (ultimately 
reduced to ls and Os) that instruet computers how to perform their most elementary opera- 
tions. Machine languages are machine-dependent , which means that a particular machine 
language can be used on only one type of computer. The following section of a machine- 
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language program, which adds overtime pay to base pay and Stores the resuit in gross pay, 
demonstrates the incomprehensibility of machine language to the human reader. 

+1300042774 

+1400593419 

+1200274027 

As the popularity of computers increased, machine-language programming proved to be 
excessively slow, tedious and error prone. Instead of using the strings of numbers that com¬ 
puters could directly understand, programmers began using English-like abbreviations to rep- 
resent the elementary operations of the computer. These abbreviations formed the basis of 
assembly languages. Translator programs called assemblers convert assembly language pro- 
grams to machine language at computer speeds. The following section of an assembly-lan- 
guage program also adds overtime pay to base pay and Stores the resuit in gross pay , but 
presents the steps more clearly to human readers than does its machine-language equivalent: 

LOAD BASEPAY 

ADD OVERPAY 

STORE GROSSPAY 

Such code is clearer to humans but incomprehensible to computers until translated into ma¬ 
chine language. 

Although computer use increased rapidly with the advent of assembly languages, these 
languages stili required many instructions to accomplish even the simplest tasks. To speed 
up the programming process, high-level languages , in which single statements accomplish 
substantial tasks, were developed. Translation programs called compilers convert high- 
level-language programs into machine language. High-level languages enable program¬ 
mers to write instructions that look almost like everyday English and contain common 
mathematical notations. A payroll program written in a high-level language might contain 
a statement such as 

grossPay = basePay + overTimePay 

Obviously, programmers prefer high-level languages to either machine languages or as¬ 
sembly languages. C, C++, C# (pronounced “C sharp”), Java, Visual Basic, Perl and Py¬ 
thon are among the most popular high-level languages. 

Compiling a high-level language program into machine language can require a consid- 
erable amount of time. This problem was solved by the development of interpreter programs 
that can execute high-level language programs directly, bypassing the compilation step, and 
interpreters can start running a program immediately without “suffering” a compilation delay. 
Although programs that are already compiled execute faster than interpreted programs, inter¬ 
preters are popular in program-development environments. In these environments, devel- 
opers change programs frequently as they add new features and correct errors. Once a 
program is fully developed, a compiled version can be produced so that the program runs at 
maximum efficiency. As we will see throughout this book, interpreted languages—like 
Python—are particularly popular for implementing World Wide Web applications. 

1.7 Strue tu red Programming 

During the 1960s, many large software-development efforts encountered severe difficul- 
ties. Development typically ran behind schedule, costs often greatly exceeded budgets and 
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the fmished products were unreliable. People began to realize that Software development 
was a far more complex activity than they had imagined. Research activity, intended to ad- 
dress these issues, resulted in the evolution of structuredprogramming —a disciplined ap- 
proach to the creation of programs that are ciear, demonstrably correct and easy to modify. 

One of the more tangible results of this research was the development of the Pascal 
programming language in 1971. Pascal, named after the seventeenth-century mathemati- 
cian and philosopher Blaise Pascal, was designed for teaching structured programming in 
academic environments and rapidly became the preferred introductory programming lan¬ 
guage in most universities. Unfortunately, because the language lacked many features 
needed to make it useful in commercial, industrial and government applications, it was not 
widely accepted in these environments. By contrast, C, which also arose from research on 
structured programming, did not have the limitations of Pascal, and became extremely 
popular. 

The Ada programming language was developed under the sponsorship of the United 
States Department of Defense (DOD) during the 1970s and early 1980s. Hundreds of pro¬ 
gramming languages were being used to produce DOD’s massive command-and-control 
Software systems. DOD wanted a single language that would meet its needs. Pascal was 
chosen as a base, but the final Ada language is quite different from Pascal. The language 
was named after Lady Ada Lovelace, daughter of the poet Lord Byron. Lady Lovelace is 
generally credited with writing the world’s first computer program, in the early 1800s (for 
the Analytical Engine mechanical computing device designed by Charles Babbage). One 
important capability of Ada is multitasking , which allows programmers to specify that 
many activities are to occur in parallel. As we will see in Chapters 18-19, Python offers 
process management and multithreading —two capabilities that enable programs to specify 
that various activities are to proceed in parallel. 

1.8 Object-Oriented Programming 

One of the authors, HMD, remembers the great frustration felt in the 1960s by software- 
development organizations, especially those developing large-scale projects. During the 
summers of his undergraduate years, HMD had the privilege of working at a leading com¬ 
puter vendor on the teams developing time-sharing, virtual-memory operating systems. It 
was a great experience for a college student, but, in the summer of 1967, reality set in. The 
company “decommitted” from producing as a commercial product the particular system 
that hundreds of people had been working on for several years. It was difficult to get this 
Software right. Software is “complex stuff.” 

As the benefits of structured programming (and the related disciplines of structured 
systems analysis and design ) were realized in the 1970s, improved Software technology did 
begin to appear. However, it was not until the technology of object-oriented programming 
became widely used in the 1980s and 1990s that Software developers finally felt they had 
the necessary tools to improve the Software-development process dramatically. 

Actually, object technology dates back to at least the mid-1960s, but no broad-based 
programming language incorporated the technology until C++. Although not strictly an 
object-oriented language, C++ absorbed the capabilities of C and incorporated Simula’s 
ability to create and manipulate objects. C++ was never intended for widespread use 
beyond the research laboratories at AT&T, but grass-roots support rapidly developed for 
the hybrid language. 
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What are objects, and why are they special? Object technology is a packaging scheme 
that facilitates the creation of meaningful Software units. These units are large and focused 
on particular applications areas. There are date objects, time objects, paycheck objects, 
invoice objects, audio objects, video objects, file objects, record objects and so on. In fact, 
almost any noun can be reasonably represented as a Software object. Objects have proper- 
ties (i.e., attributes, such as color, size and weight) and perform actions (i.e., behaviors , 
such as moving, sleeping or drawing). Classes represent groups of related objects. For 
example, all cars belong to the “car” class, even though individual cars vary in make, 
model, color and options packages. A class specifies the general format of its objects; the 
properties and actions available to an object depend on its class. 

We live in a world of objects. Just look around you—there are cars, planes, people, ani- 
mals, buildings, traffic lights, elevators and so on. Before object-oriented languages 
appeared, procedural programming languages (such as Fortran, Pascal, BASIC and C) 
focused on actions (verbs) rather than things or objects (nouns). We live in a world of 
objects, but earlier programming languages forced individuals to program primarily with 
verbs. This paradigm shift made program writing a bit awkward. However, with the advent 
of popular object-oriented languages, such as C++, Java, C# and Python, programmers can 
program in an object-oriented manner that reflects the way in which they perceive the 
world. This process, which seems more natural than procedural programming, has resulted 
in significant productivity gains. 

One of the key problems with procedural programming is that the program units cre- 
ated do not mirror real-world entities effectively and therefore are not particularly reusable. 
Programmers often write and rewrite similar Software for various projects. This wastes pre- 
cious time and money as people repeatedly “reinvent the wheel.” With object technology, 
properly designed Software entities (called objects) can be reused on future projects. Using 
libraries of reusable componentry can greatly reduce the amount of effort required to imple- 
ment certain kinds of systems (as compared to the effort that would be required to reinvent 
these capabilities in new projects). 

Some organizations report that Software reusability is not, in fact, the key benefit of 
object-oriented programming. Rather, they indicate that object-oriented programming 
tends to produce Software that is more understandable because it is better organized and has 
fewer maintenance requirements. As much as 80 percent of Software costs are not associ- 
ated with the original efforts to develop the Software, but instead are related to the con- 
tinued evolution and maintenance of that Software throughout its lifetime. Object 
orientation allows programmers to abstract the details of Software and focus on the “big pic¬ 
ture.” Rather than worrying about minute details, the programmer can focus on the behav¬ 
iors and interactions of objects. A roadmap that showed every tree, house and driveway 
would be difficult, if not impossible, to read. When such details are removed and only the 
essential information (roads) remains, the map becomes easier to understand. In the same 
way, a program that is divided into objects is easy to understand, modify and update 
because it hides much of the detail. It is ciear that object-oriented programming will be the 
key programming methodology for at least the next decade. 

1.9 Hardware Trends 

Every year, people generally expect to pay at least a little more for most products and Ser¬ 
vices. The opposite has been the case in the computer and Communications fields, especial- 
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ly with regard to the costs of hardware supporting these technologies. For many decades, 
and continuing into the foreseeable future, hardware costs have fallen rapidly, if not precip- 
itously. Every year or two, the capacities of computers approximately double. 1 This is es- 
pecially true in relation to the amount of memory that computers have for programs, the 
amount of secondary storage (such as disk storage) computers have to hold programs and 
data over longer periods of time and their processor speeds—the speeds at which computers 
execute their programs (i.e., do their work). Similar improvements have occurred in the 
Communications field, in which costs have plummeted as enormous demand for bandwidth 
(i.e., information-carrying capacity of communication lines) has attracted tremendous com- 
petition. We know of no other fields in which technology moves so quickly and costs fall 
so rapidly. Such phenomenal improvement in the computing and Communications fields is 
truly fostering the so-called Information Revolution. 

When computer use exploded in the 1960s and 1970s, many people discussed the dra- 
matic improvements in human productivity that computing and Communications would 
cause. However, these improvements did not materialize. Organizations were spending 
vast sums of capital on computers and employing them effectively, but without fully real- 
izing the expected productivity gains. The invention of microprocessor chip technology 
and its wide deployment in the late 1970s and 1980s laid the groundwork for the produc¬ 
tivity improvements that individuals and businesses have achieved in recent years. 

1.10 Hisbory of the Internet and World Wide Web 

In the late 1960s, one of the authors (HMD) was a graduate student at MIT. His research at 
MIT’s Project Mac (now the Laboratory for Computer Science—the home of the World 
Wide Web Consortium) was funded by ARPA—the Advanced Research Projects Agency 
of the Department of Defense. ARPA sponsored a conference at which several dozen 
ARPA-funded graduate students were brought together at the University of Illinois at Ur- 
bana-Champaign to meet and share ideas. During this conference, ARPA rolled out the 
blueprints for networking the main computer systems of approximately a dozen ARPA- 
funded universities and research institutions. The computers were to be connected with 
Communications lines operating at a then-stunning 56 Kbps (1 Kbps is equal to 1,024 bits 
per second), at a time when most people (of the few who had access to networking technol¬ 
ogies) were connecting over telephone lines to computers at a rate of 110 bits per second. 
HMD vividly recalls the excitement at that conference. Researchers at Harvard talked about 
communicating with the Univac 1108 “supercomputer,” which was located across the 
country at the University of Utah, to handle calculations related to their computer graphics 
research. Many other intriguing possibilities were discussed. Academic research was about 
to take a giant leap forward. Shortly after this conference, ARPA proceeded to implement 
what quickly became called the ARPAnet, the grandparent of today’s Internet. 

Things worked out differently from the original plan. Although the ARPAnet did 
enable researchers to network their computers, its chief benefit proved to be the capability 
for quick and easy communication via what came to be known as electronic mail ( e-mail). 
This is true even on today’s Internet, with e-mail, instant messaging and file transfer facil- 
itating Communications among hundreds of millions of people worldwide. 


1. This often is called Moore ’s Law. 
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The network was designed to operate without centralized control. This meant that, if a 
portion of the network should fail, the remaining working portions would stili be able to 
route data packets from senders to receivers over alternative paths. 

The protocol (i.e., set of rules) for communicating over the ARPAnet became known 
as the Transmission Control Protocol (TCP). TCP ensured that messages were properly 
routed from sender to receiver and that those messages arrived intact. 

In parallel with the early evolution of the Internet, organizations worldwide were 
implementing their own networks to facilitate both intra-organization (i.e., within the orga- 
nization) and inter-organization (i.e., between organizations) communication. A huge 
variety of networking hardware and Software appeared. One challenge was to enable these 
diverse products to communicate with each other. ARPA accomplished this by developing 
the Internet Protocol ( IP), which created a true “network of networks,” the current archi- 
tecture of the Internet. The combined set of protocols is now commonly called TCP/IP. 

Initially, use of the Internet was limited to universities and research institutions; later, 
the military adopted the technology. Eventually, the government decided to allow access to 
the Internet for commercial purposes. When this decision was made, there was resentment 
among the research and military communities—it was felt that response times would 
become poor as “the Net” became saturated with so many users. 

In fact, the opposite has occurred. Businesses rapidly realized that, by making effective 
use of the Internet, they could refine their operations and offer new and better Services to 
their clients. Companies started spending vast amounts of money to develop and enhance 
their Internet presence. This generated fierce competition among Communications carriers 
and hardware and Software suppliers to meet the increased infrastructure demand. The 
resuit is that bandwidth on the Internet has increased tremendously, while hardware costs 
have plummeted. It is widely believed that the Internet played a significant role in the eco- 
nomic growth that many industrialized nations experienced over the last decade. 

The World Wide Web (WWW) allows computer users to locate and view multimedia- 
based documents (i.e., documents with text, graphics, animations, audios and/or videos) 
on almost any subject. Even though the Internet was developed more than three decades 
ago, the introduction of the World Wide Web was a relatively recent event. In 1989, Tim 
Berners-Lee of CERN (the European Organization for Nuclear Research) began to 
develop a technology for sharing information via hyperlinked text documents. Basing the 
new language on the well-established Standard Generalized Markup Language 
(SGML) —a Standard for business data interchange—Berners-Lee called his invention the 
HyperText Markup Language (HTML). He also wrote communication protocols to form 
the backbone of his new hypertext information system, which he referred to as the World 
Wide Web. 

Historians will surely list the Internet and the World Wide Web among the most impor¬ 
tant and profound creations of humankind. In the past, most computer applications ran on 
“stand-alone” computers (computers that were not connected to one another). Today’s 
applications can be written to communicate among the world’s hundreds of millions of 
computers. The Internet and World Wide Web merge computing and Communications 
technologies, expediting and simplifying our work. They make information instantly and 
conveniently accessible to large numbers of people. They enable individuals and small 
businesses to achieve worldwide exposure. They are profoundly changing the way we do 
business and conduct our personal lives. People can search for the best prices on virtually 
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any product or Service. Special-interest communities can stay in touch with one another. 
Researchers can be made instantly aware of the latest breakthroughs worldwide. 

We have written two books for academic courses that convey fundamental principies 
of computing in the context of Internet and World Wide Web programming— Internet and 
World Wide Web How to Program: Second Edition and e-Business and e-Commerce How 
to Program. 

1.11 World Wide Web Consortium (W3C) 

In October 1994, Tim Berners-Lee founded an organization, called the World Wide Web 
Consortium ( W3C ), that is devoted to developing nonproprietary, interoperable technolo- 
gies for the World Wide Web. One of the W3C’s primary goals is to make the Web univer- 
sally accessible—regardless of disabilities, language or culture. 

The W3C is also a standardization organization and is comprised of three hosts —the 
Massachusetts Institute of Technology (MIT), France’s INRIA (Institut National de 
Recherche en Informatique et Automatique) and Keio University of Japan—and over 400 
members, including Deitel & Associates, Inc. Members provide the primary financing for 
the W3C and help provide the strategic direction of the Consortium. To learn more about 
the W3C, visit www. w3 . org. 

Web technologies standardized by the W3C are called Recommendations. Current W3C 
Recommendations include Extensible HyperText Markup Language (XHTML™), Cas- 
cading Style Sheets (CSS™) and the Extensible Markup Language (XML). Recommenda¬ 
tions are not actual Software products, but documents that specify the role, syntax and rules 
of a technology. Before becoming a W3C Recommendation, a document passes through 
three major phases: Working Draft —which, as its name implies, specifies an evolving draft; 
Candidate Recommendation —a stable version of the document that industry can begin to 
implement; and Proposed Recommendation —a Candidate Recommendation that is consid- 
ered mature (i.e., has been implemented and tested over a period of time) and is ready to be 
considered for W3C Recommendation status. For detailed information about the W3C Rec¬ 
ommendation track, see “6.2 The W3C Recommendation track” at 

www.w3.org/Consortium/Process/Process-19991111/ 

process.htmlttRecsCR 

1.12 Extensible Maikup Language (XML) 

As the popularity of the Web exploded, HTML’s limitations became apparent. HTML’s 
lack of extensibility (the ability to change or add features) frustrated developers, and its am- 
biguous definition allowed erroneous HTML to proliferate. In response to these problems, 
the W3C added limited extensibility to HTML. This was, however, only a temporary solu- 
tion—the need for a standardized, fully extensible and structurally striet language was ap¬ 
parent. As a resuit, XML was developed by the W3C. XML combines the power and 
extensibility of its parent language, Standard Generalized Markup Language (SGML), with 
the simplicity that the Web community demands. At the same time, the W3C began devel¬ 
oping XML-based standards for style sheets and advanced hyperlinking. Extensible 
Stylesheet Language (XSL ) incorporates elements of both Cascading Style Sheets (CSS), 
which is used to format HTML documents and Document Style and Semantics Specifica¬ 
tiori Language (DSSSL ), which is used to format SGML documents. Similarly, the Exten- 
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sible Linking Language (XLink ) combines ideas from HyTime and the Text Encoding 
Initiative (TEI), to provide extensible linking of resources. 

Data independence, the separation of content from its presentation, is the essential 
characteristic of XML. Because an XML document describes data, any application con- 
ceivably can process an XML document. Recognizing this, Software developers are inte- 
grating XML into their applications to improve Web functionality and interoperability. 
XML’s flexibility and power make it perfect for the middle tier of client/server systems, 
which must interact with a wide variety of clients. Much of the processing that was once 
limited to server computers now can be performed by client computers, because XML’s 
semantic and structural information enables it to be manipulated by any application that can 
process text. This reduces server loads and network traffic, resulting in a faster, more effi¬ 
cient Web. 

XML is not limited to Web applications. Increasingly, XML is being employed in data- 
bases—the structure of an XML document enables it to be integrated easily with database 
applications. As applications become more Web enabled, it seems likely that XML will 
become the universal technology for data representation. All applications employing XML 
would be able to communicate, provided that they could understand each other’s XML 
markup, or vocabulary. 

Simple Object Access Protocol (SOAP) is a technology for the distributiori of objects 
(marked up as XML) over the Internet. Developed primarily by Microsoft and Develop- 
Mentor, SOAP provides a framework for expressing application semantics, encoding that 
data and packaging it in modules. SOAP has three parts: The envelope, which describes the 
content and intended recipient of a SOAP message; the SOAP encoding rules, which are 
XML-based; and the SOAP Remote Procedure Call ( RPC) representation for commanding 
other computers to perform a task. SOAP is supported by many platforms, because of its 
foundations in XML and HTTP. We discuss XML in Chapter 15, Extensible Markup Lan¬ 
guage (XML) and in Chapter 16, XML Processing. 

1.13 Open-Source Software Revolution 

When the source code of a program is freely available to any developer to modify, to redis- 
tribute and to use as a basis for other Software, it is called open-source Software ? In con- 
trast, closed-source Software restricts other developers from creating Software programs 
whose source code is based on closed-source programs. 

The concept of open-source technologies is not new. The development of open-source 
technologies was an important factor in the growth of modern computing in 1960s. Specif- 
ically, the United States government funded what became today’s Internet and encouraged 
computer scientists to develop technologies that could facilitate distributed computing on 
various computer platforms. 2 3 Out of these efforts came technologies such as the protocols 
used to communicate over today’s Internet. After the Internet was established, closed- 
source technologies and Software became the norm in the Software industry, and open- 
source feli from popular use in the 1980s and early 1990s. In response to the “closed” 


2. The Open Source Initiative’s definition includes nine requirements to which Software must com- 
ply before it is considered “open source.” To view the entire definition, visit <www.open- 
source .org/docs/definition.html>. 

3. <www.opensource.org>. 
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nature of most commercial Software and programmers’ frustrations with the lack of respon- 
siveness from closed-source vendors, open-source Software, regained popularity. Today, 
Python is part of a growing open-source Software community, which includes the Linux 
operating system, the Perl scripting language, the Apache Web server and hundreds of 
other Software projects. 

Some people in the computer industry equate open-source with “free” Software. In most 
cases, this is true. However, “free” in the context of open-source Software is thought of most 
appropriately as “freedom”—the freedom for any developer to modify source code, to 
exchanges ideas, to participate in the software-development process and to develop new 
Software programs based on existing open-source Software. Most open-source Software is 
copyrighted and licenses are associated with the use of the Software. Open-source licenses 
vary in their terms; some impose few restrictions (e.g., the Artistic license 4 ), whereas others 
require many restrictions on the manner in which the Software may be modified and used. 
Usually, either an individual developer or an organization maintains the Software copyrights. 
To view an example of a license, visit www. python. org/2.2/license. html toread 
the Python agreement. 

Typically, the source code for open-source products is available for download over the 
Internet. This enables developers to learn from, validate and modify the source code to meet 
their own needs. With a community of developers, more people review the code so issues 
such as performance and security problems are detected and resolved faster than they 
would be in closed-source Software development. Additionally, a larger community of 
developers can contribute more features. Often, code fixes are available within hours, and 
new versions of open-source Software are available more frequently than are versions of 
closed-source Software. Open-source licenses often require that developers publish any 
enhancements they make so that the open-source community can continue to evolve those 
products. For example, Python developers participate in the comp. lang. python news- 
group to exchange ideas regarding the development of Python. Python developers also can 
document and submit their modifications to the Python Software Foundation through 
Python Enhancement Proposals (PEPS), which enables the Python group to evaluate the 
proposed changes and incorporate the ones they choose in future releases. 5 

Many companies, (e.g., IBM, Red Hat and Sun) support open-source developers and 
projects. Sometimes companies take open-source applications and sell them commercially 
(this depends on Software licensing). For-profit companies also provide Services such as sup¬ 
port, custom-made Software and training. Developers can offer their Services as consultants 
or trainers to businesses implementing the Software. 6 For more information about open- 
source Software, visit the Open Source Initiative’s Web site at www. opensource. org. 

1.14 History of Python 

Python began in late 1989. At that time, Guido van Rossum, a researcher at the National 
Research Institute for Mathematics and Computer Science in Amsterdam ( CWI), needed a 
high-level scripting language to accomplish administrative tasks for his research group’s 


4. <www.opensource.org/licenses/artistic-license.html>. 

5. <www.python.org>. 

6. <www-106. ibm.com/developerworks/opensource/library/license .ht- 
ml?dwzone=opensource>. 






























pythonhtpl_01.fm Page 15 Monday, December 10, 2001 12:13 PM 


Chapter 1 Introduction to Computers, Internet and World Wide Web 15 


Amoeba distributed operating system. To create this new language, he drew heavily from 
Ali Basic Code (ABC) —a high-level teaching language—for syntax, and from Modula-3, a 
systems programming language, for error-handling techniques. However, one major short- 
coming of ABC was its lack of extensibility; the language was not open to improvements 
or extensions. So, van Rossum decided to create a language that combined many of the el- 
ements he liked from existing languages, but one that could be extended through classes 
and programming interfaces. He named this language Python, after the popular comic 
troupe Monty Python. 

Since its public release in early 1991, a growing community of Python developers and 
users have improved it to create a mature and well-supported programming language. 
Python has been used to develop a variety of applications, from creating Online e-mail pro- 
grams to controlling underwater vehicles, configuring operating systems and creating ani- 
mated films. In 2001, the core Python development team moved to Digital Creations, the 
creators of Zope —a Web application server written in Python. It is expected that Python 
will continue to grow and expand into new programming realms. 

1.15 Python Modules 

Python is a modularly extensible language; it can incorporate new modules (reusable pieces 
of Software). These new modules, which can be written by any Python developer, extend 
Python’ s capabilities. The primary distribution center for Python source code, modules and 
documentation is the Python Web site —www. python. org —with pians to develop a site 
dedicated solely to maintaining Python modules. 

1.16 General Notes about Python and Ihis Book 

Python was designed so that novice and experienced programmers could learn and under- 
stand the language quickly and use it with ease. Unlike its predecessors, Python was de¬ 
signed to be portable and extensible. Python’s syntax and design promote good 
programming practices and tend to produce surprisingly rapid development times without 
sacrificing program scalability and maintenance. 

Python is simple enough to be used by beginning programmers, but powerful enough 
to attract professionals. Python How to Program introduces programming concepts through 
abundant, complete, working examples and discussions. As we progress, we begin to 
explore more complex topics by creating practical applications. Throughout the book, we 
emphasize good programming practices and portability tips and explain how to avoid 
common programming errors. 

Python is one of the most highly portable programming languages in existence. Orig- 
inally, it was implemented on UNIX, but has since spread to many other platforms, 
including Microsoft Windows and Apple Mac OS X. Python programs often can be ported 
from one operating system to another without any change and stili execute properly. 

1.17 lourofthe Book 

In this section, we take a tour of the subjects introduced in Python How to Program. Some 
chapters end with an Internet and World Wide Web Resources section, which lists resourc- 
es that provide additional information on Python programming. 
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Chapter 1—Introduction to Computers, the Internet and the World Wide Web 
In this chapter, we discuss what computers are, how they work and how they are pro- 
grammed. The chapter introduces structured programming and explains why this set of 
techniques has fostered a revolution in the way programs are written. A brief history of the 
development of programming languages—from machine languages, to assembly languag- 
es to high-level languages—is included. We present some historical information about 
computers and computer programming and introductory information about the Internet and 
the World Wide Web. We discuss the origins of the Python programming language and 
overview the concepts introduced in the remaining chapters of the book. 

Chapter 2—Introduction to Python Programming 

Chapter 2 introduces a typical Python programming environment and the basic syntax for 
writing Python programs. We discuss how to run Python from the command line. In addition 
to the interpreter, Python can execute statements in an interactive mode in which Python state- 
ments can be typed and executed. Throughout the chapter and the book, we include several 
interactive sessions to highlight and illustrate various subtle programming points. In this 
chapter, we discuss variables and introduce arithmetic, assignment, equality, relational and 
string operators. We introduce decision-making and arithmetic operations. Strings are a basic 
and powerful built-in data type. We introduce some Standard output-formatting techniques. 
We discuss the concept of objects and variables. Objects are containers for values and vari¬ 
ables are names that reference objects. Our Python programs use syntax coloring to highlight 
keywords, comments and regular program text. After studying this chapter, readers will un- 
derstand how to write simple but complete Python programs. 

Chapter 3—Control Structures 

This chapter introduces algorithms (procedures) for solving problems. It explains the impor- 
tance of using control structures effectively in producing programs that are understandable, 
debuggable, maintainable and more likely to work properly on the first try. The chapter intro¬ 
duces selection structures (if, if/else and if/elif/else) and repetition structures 
(while and for). It examines repetition in detail and compares counter-controlled and sen- 
tinel-controlled loops. We explain the technique of top-down, stepwise refinement which is 
critical to the production of properly structured programs and the creation of the popular pro¬ 
gram design aid, pseudocode. The chapter examples and case studies demonstrate how quick- 
ly and easily pseudocode algorithms can be converted to working Python code. The chapter 
contains an explanation of break and continue —statements that alter the flow of con¬ 
trol. We show how to use the logical operators and, or and not to enable programs to 
make sophisticated decisions. The chapter includes several interactive sessions that dem¬ 
onstrate how to create a for structure and how to avoid several common programming er- 
rors that arise in structured programming. The chapter concludes with a summary of 
structured programming. The techniques presented in Chapter 3 are applicable for effective 
use of control structures in any programming language, not just Python. This chapter helps 
the student develop good programming habits in preparation for dealing with the more sub- 
stantial programming tasks in the remainder of the text. 

Chapter 4—Functions 

Chapter 4 discusses the design and construction of functions. Python’ s function-related ca- 
pabilities include built-in functions, programmer-defined functions and recursion. The 
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techniques presented in Chapter 4 are essential for creating properly structured programs— 
especially the larger programs and Software that system programmers and application pro- 
grammers are likely to develop in real-world applications. The “divide and conquer” strat- 
egy is presented as an effective means for solving complex problems by dividing them into 
simpler interacting components. We begin by introducing modules as containers for groups 
of useful functions. We introduce module math and discuss the many mathematics-related 
functions the module contains. Students enjoy the treatment of random numbers and simu- 
lation, and they are entertained by a study of the dice game, craps, which makes elegant use 
of control structures. The chapter illustrates how to solve a Fibonacci and factorial problem 
using a programming technique called recursion in which a function calls itself. Scope 
rules are discussed in the context of an example that examines local and global variables. 
The chapter also discusses the various ways a program can import a module and its ele- 
ments and how the import statement affects the program’s namespace. Python functions 
can specify default arguments and keyword arguments. We discuss both ways of passing 
information to functions and illustrate some common programming errors in an interactive 
session. The exercises present traditional mathematics and computer-science problems, in- 
cluding how to solve the famous Towers of Hanoi problem using recursion. Another exer- 
cise asks the reader to display the prime numbers from 2-100. 

Chapter 5 — Lists, Tuples and Dictionaries 

This chapter presents a detailed introduction to three high-level Python data types: lists, tu¬ 
ples and dictionaries. These data types enable Python programmers to accomplish complex 
tasks through minimal lines of code. Strings, lists and tuples are all sequences —a data type 
that can be manipulated through indexing and “slicing.’’ We discuss how to create, access 
and manipulate sequences and present an example that creates a histogram from a sequence 
of values. We consider the different ways lists and tuples are used in Python programs. Dic¬ 
tionaries are “mappable” types—keys are stored with (or mapped to) their associated val¬ 
ues. We discuss how to create, initialize and manipulate dictionaries in an example that 
Stores student grades. We introduce methods —functions that perform the operations of ob- 
jects, such as lists and dictionaries—and how to use methods to access, sort and search data. 
These methods easily perform algorithmic tasks that normally require abundant lines of 
code in other languages. We consider immutable sequences—which cannot be altered— 
and mutable sequences—which can be altered. An important and perhaps unexpected “side 
effect” occurs when passing mutable sequences to functions—we present an example to 
show the ramifications of this side effect. The exercises at the end of the chapter address 
elementary sorting and searching algorithms and other programming techniques. 

Chapter 6—Introduction to the Common Gateway Interface (CGI) 

Chapter 6 illustrates a protocol for interactions between applications (CGI programs or 
Scripts) and Web servers. The chapter introduces the HyperText Transfer Protocol (HTTP), 
which is a fundamental component in the communication of data between a Web server and 
a Web browser. We explain how a client computer connects to a server computer to request 
information over the Internet and how a Web server runs a CGI program then sends a re¬ 
sponse to the client. The most common data sent from a Web server to a Web browser is a 
Web page—a document that is formatted with the Extensible HyperText Markup Language 
(XHTML). In this chapter, we learn how to create simple CGI Scripts. We also show how 
to send user input from a browser to a CGI script with an example that displays a person’ s 





























pythonhtpl_01.fm Page 18 Monday, December 10, 2001 12:13 PM 


18 Introduction to Computers, Internet and World Wide Web Chapter 1 


name in a Web browser. We then focus on how to send user input to a CGI script by using 
an XHTML form to pass data between the client and the CGI program on the server. We 
demonstrate how to use module egi to process form data. The chapter contains descrip- 
tions of various HTTP headers used with CGI. We conclude by integrating the CGI mate- 
rial into a Web portal case study that allows the user to log in to a fictional travel Web site 
and to view information about special offers. 

Chapter 7 — Object-Based Programming 

In this chapter, we begin our discussion of object-based programming. The chapter repre- 
sents a wonderful opportunity for teaching data abstraction the “right way”—through the 
Python language that was designed from the ground up to be object-oriented. In recent 
years, data abstraction has become an important topic in introductory computing courses. 
We discuss how to implement a time abstract data type with a class and how to initialize 
and access data members of the class. Unlike other languages, Python does not permit pro- 
grammers to prohibit attribute access. In this and the next two chapters, we discuss several 
access-control techniques. We introduce “private” attributes as well as get and set methods 
that control access to data. Ali objects and classes have attributes in common, and we dis¬ 
cuss their names and values. We discuss default constructors and expand our example fur- 
ther. We also introduce the raise statement for indicating errors. Classes can contain 
class attributes—data that are created once and used by all instances of the class. We also 
discuss an example of composition, in which instances contain references to other instances 
as data members. The chapter concludes with a discussion of Software reusability. The 
more mathematically inclined reader will enjoy the exercise on creating class Rational 
(for rational numbers). 

Chapter 8—Customizing Classes 

This chapter discusses the several methods Python provides for customizing the behavior 
of a class. These methods extend the access-control mechanism introduced in the previous 
chapter. Perhaps the most powerful of the customization techniques is operator overload- 
ing, which enables the programmer to teli the Python interpreter how to use existing oper- 
ators with objects of new types. Python already knows how to use these operators with 
objects of built-in types such as integers, lists and strings. But suppose we create a new Ra¬ 
tional class—what would the plus sign (+) denote when used between Rational ob¬ 
jects? In this chapter, the programmer will learn how to “overload” the plus sign so that, 
when it is written between two Rational objects in an expression, the interpreter will 
generate a method call to an “operator method” that “adds” the two Rational objects. 
The chapter discusses the fundamentals of operator overloading, restrictions in operator 
overloading, overloading unary and binary operators and converting between types. The 
chapter also discusses how to customize a class so it contains list- or dictionary-like behav- 
iors. The more mathematically inclined student will enjoy creating class Polynomial. 

Chapter 9 — Object-Oriented Programming: Inheritance 

This chapter introduces one of the most fundamental capabilities of object-oriented pro¬ 
gramming languages: inheritance. Inheritance is a form of Software reusability in which 
new classes are developed quickly and easily by absorbing the capabilities of existing class¬ 
es and adding appropriate new capabilities. The chapter discusses the notions of base class¬ 
es and derived classes, direct-base classes, indirect-base classes, constructors and 
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destructors in base classes and derived classes, and Software engineering with inheritance. 
This chapter compares various object-oriented relationships, such as inheritance and com- 
position. Inheritance leads to programming techniques that highlight one of Python’s most 
powerful built-in features— polymorphism. When many classes are related through inher¬ 
itance to a common base class, each derived-class object may be treated as a base-class in- 
stance. This enables programs to be written in a general manner independent of the specific 
types of the derived-class objects. New kinds of objects can be handled by the same pro- 
gram, thus making systems more extensible. This style of programming is commonly used 
to implement today’s popular graphical user interfaces (GUIs). The chapter concludes 
with a discussion of the new object-oriented programming techniques available in Python 
version 2.2. 

Chapter 10—Graphical User Interface Components: Part 1 

Chapter 10 introduces Tkinter, a module that provides a Python interface to the popular 
Tool Command Language/Tool Kit (Tcl/Tk) graphical-user-interface (GUI) toolkit. The 
chapter begins with a detailed overview of the Tkinter module. Using Tkinter, the 
programmer can create graphical programs quickly and easily. We illustrate several basic 
Tkinter components — Label, Button, Entry, Checkbutton and Radio- 
button. We discuss the concept of event-handling that is Central to GUI programming 
and present examples that show how to handle mouse and keyboard events in GUI appli- 
cations. We conclude the chapter with a more in-depth examination of the pack, grid 
and place Tk layout managers. The exercises ask the reader to use the concepts presented 
in the chapter to create practical applications, such as a program that allows the user to con- 
vert temperature values between scales. Another exercise asks the reader to create a GUI 
calculator. After completing this chapter, the reader should be able to understand most 
Tkinter applications. 

Chapter 11—Graphical User Interface Components: Part 2 

Chapter 11 discusses additional GUI-programming topics. We introduce module Pmw, 
which extends the basic Tk GUI widget set. We show how to create menus, popup menus, 
scrolled text boxes and Windows. The examples demonstrate copying text from one win- 
dow to another, allowing the user to select and display images, changing the text font and 
changing the background color of a window. Of particular interest is the 35-line program 
that allows the user to draw pictures on a Canvas component with a mouse. The chapter 
concludes with a discussion of alternative GUI toolkits available to the Python program¬ 
mer, including pyGTK, pyOpenGL and wxWindows. One of the chapter exercises asks 
the reader to enhance the temperature-conversion example from the previous chapter. A 
second exercise asks the reader to create a simple program that draws a shape on the screen. 
In another exercise, the reader filis the shape with a color selected from menu. Many exam¬ 
ples throughout the remainder of the book use the GUI techniques shown in Chapters 10 
and 11. After completing Chapters 10 and 11, the reader will be prepared to write the GUI 
portions of programs that perform database operations, networking tasks and simple games. 

Chapter 12—Exception Handling 

This chapter enables the programmer to write programs that are more robust, more fault tol¬ 
erant and more appropriate for business-critical and mission-critical environments. We be- 
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gin the chapter with an explanation of exception-handling techniques. We then discuss 
when exception handling is appropriate and introduce the basies of exception handling with 
try/except/else statements in an example that gracefully handles the fatal logic error 
of dividing by zero. The programmer can raise exceptions specifically using the raise 
statement; we discuss the syntax of this statement and demonstrate its use. The chapter ex- 
plains how to extract information from exceptions and how and when to raise exceptions. 
We explain the f inally statement and provide a detailed explanation of when and where 
exceptions are caught in programs. In Python, exceptions are classes. We discuss how ex¬ 
ceptions relate to classes by examining the exception hierarchy and how to create custom 
exceptions. The chapter concludes with an example that takes advantage of the capabilities 
of module traceback to examine the nature and contents of Python exceptions. 

Chapter 13—String Manipulation and Regular Expressioris 

This chapter explores how to manipulate string appearance, order and contents. Strings 
form the basis of most Python output. The chapter discussion includes methods count, 
f ind and index, which search strings for substrings. Method split breaks a string into 
a list of strings. Method replace replaces a substring of a string with another substring. 
These methods provide basic text manipulation capabilities, but programmers often require 
more powerful pattern-based text manipulation. The re regular-expression module pro¬ 
vides pattern-based text manipulation in Python. Regular-expression processing can be a 
complex subject, with many pitfalls. We present several sections that range from basic reg¬ 
ular expressions to more substantial topies. We point out the most common programming 
mistakes and include examples that highlight how these mistakes occur and how to avoid 
them. The sections discuss the common functions and classes of module re and the com¬ 
mon regular-expression metacharacters and sequences. We demonstrate grouping, which 
enables programmers to retrieve information from regular-expression processing results. 
Python regular expressions can be compiled to improve regular-expression processing per- 
formance, so we discuss when it is appropriate to do this. The exercises ask the reader to 
explore common applications of regular expressions. 

Chapter 14—File Processing and Serialization 

In this chapter, we discuss the techniques for processing sequential-access and random-ac- 
cess text files. The chapter overviews the data hierarchy among bits, bytes, fields, records 
and files. Next, Python’s simple view of files and filehandles is presented. Sequential-ac¬ 
cess files are discussed using programs that show how to open and close files, how to store 
data sequentially in a file and how to read data sequentially from a file. The examples use 
the string-formatting techniques from the previous chapter to output data read from a file. 
We include a more substantial program that simulates a credit-inquiry program that re- 
trieves data from a sequential-access file and formats the output based on data obtained 
from the file. One feature of the chapter is the discussion of how the print statement can 
redirect text to an arbitrary file, including the Standard error file to which programs display 
error messages. Our discussion of random-access files uses module shelve, which pro¬ 
vides a dictionary-like interface to random-access files. We use shelve to create a file for 
random access and to read and write data to a shelve file. We include a larger transaction- 
processing programming example that employs the techniques discussed in the chapter. 
One benefit of Pythorfs high-level data types and modules is that programs can serialize 
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(save to disk) arbitrary Python objects. We present an example that uses module cPickle 
to store a Python dictionary to disk for later use. 

Chapter 15—Extensible Markup Language (XML) 

XML is a language for creating markup languages. Unlike HTML, which formats Informa¬ 
tion for display, XML structures information. It does not have a fixed set of tags as HTML 
does, but instead enables the document author to create new ones. This chapter provides a 
brief overview of parsers , which are programs that process XML documents and their data, 
and the requirements for a well-formed document (i.e., a document that is syntactically cor- 
rect). We also introduce namespaces , which differentiate elements with the same name, and 
Document Type Definitiori (DTD) files and schema files, which provide a structural defini- 
tion for an XML document by specifying the type, order, number and attributes of the ele¬ 
ments in an XML document. By defining an XML document’s structure, a DTD or Schema 
reduces the validation and error-checking work of the application using the document. This 
chapter provides an introduction to an extremely popular XML-related technology—called 
the Extensible Stylesheet Language (XSL) —for transforming XML documents into other 
document formats such as XHTML. This chapter provides an overview of XML; Chapter 
16 discusses XML processing in Python. 

Chapter 16—XML Processing 

In this chapter, we discuss how Python XML processing and manipulation can be accom- 
plished simply and powerfully using Standard and third-party modules. This chapter over- 
views several ways to process XML documents. The W3C Document Object Model 
(DOM) —an Application Programming Interface (API) for XML that is platform and lan¬ 
guage neutral—is discussed. The DOM API provides a Standard set of interfaces (i.e., meth- 
ods, objects, etc.) for manipulating an XML document’s contents. XML documents are 
hierarchically structured, thus, the DOM represents XML documents as tree structures. Us¬ 
ing DOM, programs can modify the content, structure and formatting of documents dynam- 
ically. We also present an alternative to DOM called the Simple API for XML (SAX). Unlike 
DOM, which builds a tree structure in memory, SAX calls specific methods when start tags, 
end tags, attributes, etc., are encountered in a document. For this reason, SAX is often re- 
ferred to as an event-based API. Python XML support is available through modules 
xml. dom. ext (DOM) and xml. sax (SAX). In the chapter, we use 4Suite (developed by 
FourThought, Inc.) and PyXML—two collections of Python XML modules. The major fea- 
ture of this chapter is a case study that uses XML to implement a Web-based message forum. 

Chapter 17—Database Application Programming Interface (DB-API) 

This chapter enables programs to query and manipulate databases. Most substantial busi- 
ness and Web applications are based on database management systems (DBMS). To sup¬ 
port DBMS applications, Python offers the database application programming interface 
(DB-API). This chapter uses Structured Query Language (SQL) to query and manipulate 
Relational Database Management Systems (RDBMS), specifically a MySQL database. To 
interface with a MySQL database, Python uses module MySQLdb. This chapter contains 
three examples. The first is a CGI program that displays information about authors, based 
on criteria provided by the user. The second creates a GUI program that allows the user to 
enter an SQL query, then displays the results of the query. The third example is a more sub¬ 
stantial GUI program that enables the user to maintain a list of contacts. The user can add. 
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remove, update and find contacts in the database. The exercises ask the reader to modify 
these programs to provide more functionality, such as verifying that the database does not 
contain identical entries. 

Chapter 18—Process Management 

In this chapter, we discuss concurrency. Most programming languages provide a simple set 
of control structures that enable programmers to perform one action at a time and proceed to 
the next action after the previous one is finished. Such control structures do not allow most 
programming languages to perform concurrent actions. The kind of concurrency that comput¬ 
ers perform today normally is implemented as operating-system primitives available only to 
highly experienced systems programmers. Python makes concurrency primitives available to 
application programmers. We show how to use the f ork command, which creates a new pro¬ 
cess, and the exec and system commands, which execute separate programs. Techniques 
for controlling input and output with the popen command are demonstrated and explained. 
Some of these commands are available on the Unix platform only, so we point this out when 
appropriate. We also explore Python’s cross-platform capabilities through examples that per¬ 
form specific tasks based on the operating system on which the program is executing. We dis¬ 
cuss methods for communicating between processes, including pipes and signals. The signal- 
handling examples demonstrate how to discover when a user tries to interrupt a program and 
how to specify an action that the program takes when such an event occurs. 

Chapter 19—Multithreading 

This chapter introduces threads , which are “light-weight processes.” They often are more 
efficient than full-fledged processes created as a resuit of commands like f ork presented 
in the previous chapter. We examine basic threading concepts, including the various States 
in which a thread can exist throughout its life. We discuss how to include threads in a pro¬ 
gram by subclassing threading. Thread and overriding method run. The latter half 
of the chapter contains examples that address the classic producer/consumer relationship. 
We develop several Solutions to this problem and introduce the concept of thread synchro- 
nization and resource allocation. We introduce threading control primitives, such as locks, 
condition variables, semaphores and events. The final solution uses module Queue to pro- 
tect access to shared data stored in a queue. The examples demonstrate the hazards of 
threaded programs and show how to avoid these hazards. Our solution also demonstrates 
the value of writing classes for reuse. We reuse our producer and consumer classes to ac¬ 
cess various synchronized and unsynchronized data types. After completing this chapter, 
the reader will have many of the tools necessary to write substantial, extensible and profes- 
sional programs in Python. 

Chapter 20—Networking 

In this chapter, we explore applications that can communicate over computer networks. A 
major benefit of a high-level language like Python is that potentially complex topics can be 
presented and discussed easily through small, working examples. We discuss basic net¬ 
working concepts and present two examples—a CGI program that displays a chosen Web 
page in a browser and a GUI example that displays page content (e.g., XHTML) in a text 
area. We also discuss client-server communication over sockets. The programs in this sec- 
tion demonstrate how to send and receive messages over the network, using connectionless 
and connection-based protocols. A key feature of the chapter is the live-code implementa- 
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tion of a collaborative client/server Tic-Tac-Toe game in which two clients play Tic-Tac- 
Toe by interacting with a multithreaded server that maintains the state of the game. As part 
of the exercises, readers will write programs that send and receive messages and files. We 
ask the reader to modify the Tic-Tac-Toe game to determine when a player wins the game. 

Chapter 21—Security 

This chapter discusses Web programming security issues. Web programming allows the 
rapid creation of powerful applications, but it also exposes computers to outside attack. We 
focus on defensive programming techniques that help the programmer prevent security 
problems by using certain techniques and tools. One of those tools is encryption. We pro¬ 
vide an example of encryption and decryption with module rotor, which acts as a substi- 
tution cipher. Another tool is module sha, which is used to hash values. A third tool is 
Python’s restricted-access (rexec) module, which creates a restricted environment in 
which untrusted code can execute without damaging the local computer. This chapter ex¬ 
amines technologies, such as Public Key Cryptograpliy, Secure Socket Layer (SSL), digital 
signatures, digital certificates, digital steganography and biometrics, which provide net- 
work security. Other types of network security, such as firewalls and antivirus programs, 
are also covered, and common security threats including cryptanalytic attacks, viruses, 
worms and Trojan horses are discussed. 

Chapter 22—Data Structures 

Chapter 22 explores the techniques used to create and manipulate Standard data structures in 
Python. Although high-level data types are built into Python, we believe the reader will ben¬ 
efit from this conceptual and programmatic examination of common data structures. The 
chapter begins with a discussion of self-referential structures and proceeds with a discussion 
of how to create and maintain various data structures, including linked lists, queues (or wait- 
ing lines), stacks and binary trees. We reuse the linked-list class to implement queues and 
stacks, so that the code for the inherited class is minimized and emphasis is placed on code 
reuse. The binary tree class contains methods for pre-, in- and post-order traversals. For each 
type of data structure, we present complete, working programs and show sample outputs. 

Chapter 23—Case Study: Multi-Tier Online Bookstore 

This chapter implements an Online bookstore that uses MySQL, XML and XSLT to send 
Web pages to different clients. We begin the chapter with an introduction to an HTTP-ses- 
sion framework that maintains client information over several pages. The client informa- 
tion is “pickled” (serialized) on the server’s computer, to be used by the server at a later 
time. We then discuss WML, a markup language used by wireless clients to pass documents 
over the Web. Although we demonstrate the application with XHTML, XHTML Basic and 
WML clients, we designed the bookstore to be extensible, so new client types can be added 
easily. The Python CGI programs do not change, but the programmer can modify the book¬ 
store to Service new clients by simply creating new XML and XSLT documents for those 
clients. The bookstore program determines the client type and sends the appropriate data to 
the client. This chapter encompasses many topics from the previous chapters in the book 
and illustrates a major strength of Python—its ability to integrate several technologies 
quickly and easily. The topics covered include file processing, serialization (module 
cPickle), CGI form processing (module egi), database access (module MySQLdb), 
XML DOM manipulation and XSLT processing (the 4Suite set of modules.) 
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Chapter 24—Multimedia 

This chapter presents Python’s capabilities for making computer applications come alive. 
It is remarkable that students in entry-level programming courses will be writing Python 
applications with ali these capabilities. Some exciting multimedia applications include Py- 
OpenGL , a module that binds Python to OpenGL API to create colorful, interactive graph- 
ics; Alice , an environment for creating and manipulating 3D graphical worlds in an object- 
oriented manner; and Pygame, a large collection of Python modules for creating cross- 
platform, multimedia applications, such as interactive games. In our PyOpenGL examples, 
we create rotating objects and three-dimensional shapes. In the Alice example, we create a 
graphical game version of a popular riddle. The world we create contains a fox, a chicken 
and a piant. The goal is to move all three objects across a river, without leaving a predator- 
prey pair alone at any one time. Our first Pygame example combines Tkinter and Pyg¬ 
ame to create a GUI compact disc player. The second example illustrates how to play an 
MPEG movie. The final Pygame example creates a video game where the user steers a 
spaceship through an asteroid field to gather energy cells. We discuss many graphics pro- 
gram pitfalls and techniques in the context of this example. With many other programming 
languages, these projects would be too complex or detailed to present in a book such as this. 
However, Python’s high-level nature, simple syntax and ample modules enable us to 
present these exciting examples all in the same chapter! 

Chapter 25—Python Server Pages (PSP) 

In this chapter, we create dynamic Web content using familiar Extensible HyperText Markup 
Language (XHTML) syntax and Python Scripts. We discuss both sides of a client-server re- 
lationship. The tools used in this chapter include Apache and Webware for Python —a suite 
of Software for writing dynamic Web content. An explanation of Python servlets is presented 
at the beginning of this chapter. In addition to illustrating how PSP handles Python’s unique 
indentation style, our examples illustrate scriptlets , actions and directives. The exercises ask 
the reader to modify these examples by adding database connections to PSP. 

Appendix A—Operator Precedence Chart 

This appendix contains the Python operator precedence chart. 

Appendix B—ASCII Character Set 

Appendix B contains a table of the 128 ASCII alphanumeric symbols. 

Appendix C—Number Systems 

Appendix C explains the binary, octal, decimal and hexadecimal number systems. We also 
cover how to convert between bases and perform arithmetic operations in each base. 

Appendix D—Python Development Environments 

This appendix presents a brief overview of several Python Development environments, in- 
cluding IDLE. 

Appendix E—Career Resources 

This appendix provides resources related to careers in Python and related technologies. The 
Internet presents valuable resources and Services for job seekers and employers. Automatic 
search features allow employees to scan the Web for open positions. Employers also can find 
job candidates using the Internet. This reduces the amount of time spent preparing and re- 
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viewing resumes, and can minimize travel expenses for distance recruiting and interviewing. 
In this chapter, we explore career Services on the Web from the perspectives of job seekers 
and employers. We introduce comprehensive job sites, industry-specific sites (including sites 
geared specifically for Python programmers) and contracting opportunities, as well as addi- 
tional resources and career Services designed to meet the needs of a variety of individuals. 

Appendix F — Unicode® 

This appendix introduces the Unicode Standard , an encoding scheme that assigns unique 
numeric values to the characters of most of the world’s languages. It includes a Python pro- 
gram that uses Unicode encoding to print a welcome message in 10 different languages. 

Appendices G and H—Introduction to HyperText Markup Language 4:1 & 2 (on CD) 
These appendices provide an introduction to HTML—the HyperText Markup Language. 
HTML is a markup language for describing the elements of an HTML document (Web 
page) so that a browser, such as Microsoft’s Internet Explorer, can render (i.e., display) that 
page. These appendices are included for our readers who do not know HTML. Some key 
topics covered in Appendix G include incorporating text and images in an HTML docu¬ 
ment, linking to other HTML documents on the Web, incorporating special characters 
(such as Copyright and trademark symbols) into an HTML document and separating parts 
of an HTML document with horizontal rules. In Appendix H, we discuss more substantial 
HTML elements and features. We demonstrate how to present information in lists and ta- 
bles. We discuss how to collect information from people browsing a site. We explain how 
to use internal linking and image maps to make Web pages easier to navigate. We also dis¬ 
cuss how to use frames to display multiple documents in the browser window. 

Appendices I and J—Introduction to XHTML: Part 1 & 2 

In these appendices, we introduce the Extensible HyperText Markup Language (XHTML). 
XHTML is a W3C technology designed to replace HTML as the primary means of describ¬ 
ing Web content. As an XML-based language, XHTML is more robust and extensible than 
HTML. XHTML incorporates most of HTML 4’s elements and attributes—the focus of 
these appendices. Appendix I introduces the XHTML and write many simple Web pages. 
We introduce basic XHTML tags and attributes. A key issue when using XHTML is the 
separation of the presentation of a document (i.e., how the document is rendered on the 
screen by a browser) from the structure ofthat document. Appendix J continues our XHT¬ 
ML discussion with more substantial XHTML elements and features. We demonstrate how 
to present information in lists and tables and discuss how to collect information from peo¬ 
ple browsing a site. We explain internal linking and image maps —techniques that make 
Web pages easier to navigate. We show how to use frames to make attractive Web sites. 

Appendix K—Cascading Style Sheets™ (CSS) 

Appendix K discusses how document authors can control how the browser renders a Web 
page. In earlier versions of XHTML, Web browsers controlled the appearance (i.e., the ren- 
dering) of every Web page. For example, if a document author placed an hl (i.e., a large 
heading) element in a document, the browser rendered the element in its own manner, which 
was often different than the way other Web browsers would render the same document. Cas¬ 
cading Style Sheets (CSS) technology allows document authors to specify the styles of their 
page elements (spacing, margins, etc.) separately from the structure of their documents (sec- 
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tion headers, body text, links, etc.). This separation of structure from content allows greater 
manageability and makes changing the style of the document easier and faster. 

Appendix L—Accessibility 

This appendix discusses how to design accessible Web sites. Currently, the World Wide 
Web presents challenges to people with various disabilities. Multimedia-rich Web sites 
hinder text readers and other programs designed to help people with visual impairments, and 
the increasing amount of audio on the Web is inaccessible to people with hearing impair¬ 
ments. To rectify this situation, the federal government has issued several key legislation 
that address Web accessibility. For example, th eAmericans witli Disabilities Act (ADA) pro- 
hibits discrimination on the basis of a disability. The W3C started the Web Accessibility Ini- 
tiative (WAI), which provides guidelines describing how to make Web sites accessible to 
people with various impairments. This chapter provides a description of these methods, such 
as use of the <headers> tag to make tables more accessible to page readers, use of the ait 
attribute of the <img> tag to describe images, and the proper use of XHTML and related 
technologies to ensure that a page can be viewed on any type of display or reader. VoiceXML 
also can increase accessibility with speech synthesis and recognition. 

Appendix M — HTML/XHTML Special Characters (on CD) 

This appendix provides many commonly used HTML/XHTML special characters, called 
character entity references. 

Appendix N— HTML/XHTML Colors (on CD) 

This appendix lists commonly used HTML/XHTML color names and their corresponding 
hexadecimal values. 

Appendix O—Additional Python 2.2 Featnres 

This book was published as the release of Python 2.2 was impending. We integrated many 
Python 2.2 features throughout the book. However, there were a few features that we were 
unable to insert in the text. We assembled these additional features into Appendix O. As 
you read each chapter, peak ahead to Appendix O for additional discussions and live-code 
examples. 

Resources on Our Web Site 

Our Web site, www. dei tel. com, provides a number of Python-related resources to help 
you install and configure Python on your Windows or UNIX/Linux systems. The resources 
include Installing Python. Installing the Apache Web Server, Installing MySQL, Installing 
Database Application Programming Interface (DB-API) modules, Installing Webware for 
Python and Installing Third-Party Modules. 

Well, there you have it! We have worked hard to create this book and its optional Inter¬ 
active multimedia Cyber Classroom. The book is loaded with hundreds of working, Live- 
Code™ examples, programming tips, self-review exercises and answers, challenging exer- 
cises and projects and numerous study aids to help you master the material. The technolo¬ 
gies we introduce will help you write Web-based applications quickly and effectively. As 
you read the book, if something is not ciear, or if you find an error, please write to us at 
deitel@deitel.com. We will respond promptly, and we will post corrections and 
clarifications atwww.deitel.com. 
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Prentice Hali maintains www.prenhall .com/deitel —a Web site dedicated to 
our Prentice Hali textbooks, multimedia packages and Web-based training products. The 
site contains “Companion Web Sites” for each of our books that include frequently asked 
questions (FAQs), downloads, errata, updates, self-test questions and other resources. 

Deitel & Associates, Inc., contributes a weekly column to the popular InformIT news- 
letter, currently subscribed to by more than 800,000 IT professionals worldwide. For opt- 
in registration, visit www. InformIT. com. 

Deitel & Associates, Inc. also offers a free, opt-in newsletter that includes commentary 
on industry trends and developments, links to articles and resources from published books 
and upcoming publications, information on future publications, product-release schedules 
and more. For opt-in registration, visit www. deitel. com. 

You are about to start on a challenging and rewarding path. We hope you enjoy 
learning with Python How to Program as much as we enjoyed writing it! 

1.18 Internet and World Wide Web Resources 

www.python.org 

This site is the first place to look for information about Python. The Python home page provides up- 
to-date news, a FAQ, and a collection of links to Python resources on the Internet including Python 
Software, tutorials, user groups and demos. 

www.zope.com 
www.zope.org 

Zope is an extensible, open-source Web application server written in Python. It was created by Digital 
Creations—the company where the Python development team resides. 

www.activestate.com 

ActiveState creates open-source tools for programmers. The company provides a Python distribution 
called ActivePython and Komodo. an open-source Integrated Development Environment (IDE) for 
many languages, including Python, XML, Tcl and PHP. ActiveState supplies Python tools for Win¬ 
dows and a collection of Python programs called the Python Cookbook. 

homepage.ntlworld.com/tibsnj oan/python.html 

This page contains many links to people and groups that develop and use Python. 

www.ddj.com/topics/pythonurl/ 

Di: Dobb ’.s Journal, a programming publication, maintains a list of Python links at this site. 

SUMMARY 

[Note: Because this Section 1.17 is primarily a summary ofthe rest ofthe book, we do not provide 
summary bulletsfor that section.] 

• Software Controls computers (often referred to as hardware). 

• A computer is a device capable of performing computations and rnaking logical decisions at 
speeds millions, even billions, of times faster than human beings can. 

• Computers process data under the control of sets of instructions called computer programs. These 
computer programs guide the computer through orderly sets of actions specified by people called 
computer programmers. 

• The various devices that comprise a computer system (such as the keyboard, screen, disks, mem- 
ory and processing units) are referred to as hardware. 

• The computer programs that run on a computer are referred to as Software. 
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• The input unit is the “receiving” section of the computer. It obtains information (data and comput¬ 
er programs) from various input devices and places this information at the disposal of the other 
units so that the information may be processed. 

• The output unit is the “shipping” section of the computer. It takes information processed by the 
computer and places it on output devices to make it available for use outside the computer. 

• The memory unit is the rapid access, relatively low-capacity “warehouse” section of the computer. 
It retains information that has been entered through the input unit so that the information may be 
made immediately available for processing when it is needed and retains information that has al- 
ready been processed until that information can be placed on output devices by the output unit. 

• The arithmetic and logic unit (ALU) is the “manufacturing” section of the computer. It is respon- 
sible for performing calculations such as addition, subtraction, multiplication and division and for 
making decisions. 

• The Central processing unit (CPU) is the “administrative’" section of the computer. It is the com¬ 
puter's coordinator and is responsible for supervising the operation of the other sections. 

• The secondary storage unit is the long-term, high-capacity “warehousing” section of the computer. 
Programs or data not being used by the other units are normally placed on secondary storage de¬ 
vices (such as disks) until they are needed, possibly hours, days, months or even years later. 

• Early computers were capable of performing only one job or task at a time. This form of computer 
operation often is called single-user batch processing. 

• Software systems called operating systems were developed to help make it more convenient to use 
computers. Early operating systems managed the smooth transition between jobs and minimized 
the time it took for computer operators to switch between jobs. 

• Multiprogramming involves the “simultaneous” operation of many jobs on the computer—the 
computer shares its resources among the jobs competing for its attention. 

• Timesharing is a special case of multiprogramming in which dozens or even hundreds of users 
share a computer through terminals. The computer runs a small portion of one user’s job, then 
moves on to Service the next user. The computer does this so quickly that it might provide Service 
to each user several times per second, so programs appear to run simultaneously. 

• An advantage of timesharing is that the user receives almost immediate responses to requests rath- 
er than having to wait long periods for results, as with previous modes of computing. 

• In 1977, Apple Computer popularized the phenomenon of personal computing. 

• In 1981, IBM introduced the IBM Personal Computer, legitimizing personal computing in busi- 
ness, industry and government organizations. 

• Although early personal computers were not powerful enough to timeshare several users, these 
machines could be linked together in computer networks, sometimes over telephone lines and 
sometimes in local area networks (LANs) within an organization. This led to the phenomenon of 
distributed computing, in which an organization’s computing is distributed over networks to the 
sites at which the real work of the organization is performed. 

• Today, information is shared easily across computer networks, where some computers called file 
servers offer a comrnon store of programs and data that may be used by client computers distrib¬ 
uted throughout the network—hence the term client/server computing. 

• Computer languages may be divided into three general types: machine languages, assembly lan- 
guages and high-level languages. 

• Any computer can directly understand only its own machine language. Machine languages gener- 
ally consist of strings of numbers (ultimately reduced to ls and Os) that instruet computers to per- 
form their rnost elementary operations one at a time. Machine languages are machine dependent. 
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• English-like abbreviations formed the basis of assembly languages. Translator programs called as- 
semblers convert assembly-language programs to machine language at computer speeds. 

• Compilers translate high-level language programs into machine-language programs. High-level 
languages (like Python) contain English words and conventional mathematical notations. 

• Interpreter programs directly execute high-level language programs without the need for first com- 
piling those programs into machine language. 

• Although compiled programs execute much faster than interpreted programs, interpreters are pop¬ 
ular in program-development environments in which programs are recompiled frequently as new 
features are added and errors are corrected. Interpreters are also popular for developing Web-based 
applications. 

• Objects are essentially reusable Software components that model items in the real world. Modular, 
object-oriented design and implementation approaches make software-development groups more 
productive than is possible with previous popular programming techniques. Object-Oriented pro¬ 
grams are often easier to understand, correct and modify than programs developed with earlier 
methodologies. 

• FORTRAN (FORmula TRANslator) was developed by IBM Corporation between 1954 and 1957 
for scientific and engineering applications that require complex mathematical computations. 

• COBOL (COmmon Business Oriented Language) was developed in 1959 by a group of computer 
manufacturers and govemment and industrial computer users. COBOL is used primarily for com- 
mercial applications that require precise and efficient manipulation of large amounts of data. 

• C evolved from two previous languages, BCPL and B, as a language for writing operating-systems 
Software and compilers. 

• Both BCPL and B were “typeless” languages—every data item occupied one “word” in memory 
and the burden of typing variables feli on the shoulders of the programmer. The C language was 
evolved froni B by Dennis Ritchie at Bell Laboratories. 

• Pascal was designed at about the same time as C. It was created by Professor Nicklaus Wirth and 
was intended for academic use. 

• Structured programming is a disciplined approach to writing programs that are clearer than un- 
structured programs, easier to test and debug and easier to modify. 

• The Ada language was developed under the sponsorship of the United States Department of De¬ 
fense (DOD) during the 1970s and early 1980s. One important capability of Ada is called multi- 
tasking; this allows programmers to specify that many activities are to occur in parallel. 

• Most high-level languages generally allow the programmer to write programs that perform only 
one activity at a time. Python, through techniques called process management and multithreading, 
enables programmers to write programs with parallel activities. 

• Objects are essentially reusable Software components that model items in the real world. 

• Object technology dates back at least to the mid-1960s. The C++ programming language, devel¬ 
oped at AT&T by Bjame Stroustrup in the early 1980s, is based C and Simula 67. 

• In the early 1990s, researchers at Sun Microsystems® developed a purely object-oriented lan¬ 
guage called lava. 

• In the late 1960’ s, the Advanced Research Projects Agency of the Department of Defense (ARPA) 
rolled out the blueprints for networking the main computer systems of about a dozen ARPA-fund- 
ed universities and research institutions. ARPA proceeded to implement what quickly became 
called the ARPAnet, the grandparent of today’s Internet. 

• Originally designed to connect the main computer systems of about a dozen universities and research 
organizations, the Internet today is accessible by hundreds of millions of computers worldwide. 
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• One of ARPA’s primary goals for the network was to allow multiple users to send and receive In¬ 
formation at the same time over the same Communications paths (such as phone lines). The net¬ 
work operated with a technique called packet switching (stili in wide use today), in which digital 
data are sent in small packages called packets. The packets contain data, address information, er- 
ror-control information and sequencing information. The address information routes the packets 
of data to their destination. The sequencing information helps reassemble the packets (which—be- 
cause of complex routing mechanisms—can actually arrive out of order) into their original order 
for presentation to the recipients. 

• The protocol for communicating over the ARPAnet became known as TCP—Transmission Con- 
trol Protocol. TCP ensured that messages were routed properly from sender to receiver and that 
those messages arrived intact. 

• Bandwidth is the information-carrying capacity of Communications lines. 

• In 1990, Tim Berners-Lee of CERN (the European Laboratory for Particle Physics) developed the 
World Wide Web and several communication protocols that form its backbone. 

• The Web allows computer users to locate and view multimedia-intensive documents over the In¬ 
ternet. 

• Browsers view HTML (Hypertext Markup Language) documents on the World Wide Web. 

• Python is a modular extensible language; Python can incorporate new modules (reusable pieces of 
Software). 

• The primary distribution center for Python source code, modules and documentation is the Python 
Web site— www . python. org—with pians to develop a site dedicated solely to maintaining Py¬ 
thon modules. 

• Python is portable, practical and extensible. 


TERMINOLOGY 
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hardware platform 

ALU 

high-level language 

arithmetic and logic unit (ALU) 

input unit 

assembler 

input/output (I/O) 
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interpreter 
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machine dependent 
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machine independent 

Central processing unit (CPU) 
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screen 

Software 

Software reusability 
stored program 
structured programming 
supercomputer 
task 


terminal 

timesharing 

top-down, stepwise refinement 
translator program 
UNIX 
works tation 


SELF-REVIEW EXERCISES 

1.1 Fili in the blanks in each of the foliowing statements: 

a) The company that popularized the phenomenon of personal computing was_. 

b) The computer that made personal computing legitimate in business and industry was the 


c) Computers process data under the control of sets of instructions called computer 


d) The six key logical units of the computer are the_,_,_, 

_,_and the_. 

e) Python can incorporate new_(reusable pieces of Software), which can be 

written by any Python developer. 

f) The three classes of languages discussed in the chapter are_,_and 


g) The programs that translate high-level language programs into machine language are 

called_. 

h) C is widely known as the development language of the_operating system. 

i) In 2001, the core Python development team moved to Digital Creations, the creators of 
_—a Web application server written in Python. 

j) The Department of Defense developed the Ada language with a capability called 
_, which allows programmers to specify activities that can proceed in parallel. 

1.2 State whether each of the following is true or false. If false, explain why. 

a) Hardware refers to the instructions that command computers to perform actions and 
make decisions. 

b) The re regular-expression module provides pattem-based text manipulation in Python. 

c) The ALU provides temporary storage for data that has been entered through the input 
unit. 

d) Software systems called batches manage the transition between jobs. 

e) Assemblers convert high-level language programs to assembly language at computer 
speeds. 

f) Interpreter programs compile high-level language programs into machine language faster 
than compilers. 

g) Structured programming is a disciplined approach to writing programs that are ciear and 
easy to modify. 

h) Unlike other programming languages, Python is non-extensible. 

i) Objects are reusable Software components that model items in the real world. 

j) Several Canvas components include Label, Button, Entry, Checkbutton and 
Radiobutton. 


ANSWERS TO SELF-REVIEW EXERCISES 

1.1 a) Apple, b) IBM Personal Computer, c) programs. d) input unit, output unit, memory unit, 
arithmetic and logic unit (ALU), Central processing unit (CPU), secondary storage unit, e) modules. 
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f) machine languages, assembly languages, high-level languages. g) compilers. h) UNIX, i) Zope. 
j) multitasking. 

1.2 a) False. Software refers to the instructioris that control computers, also referred to as hard- 
ware. Hardware refers to the computer’s devices. b) True. c) False. The memory unit provides tem- 
porary storage for data that have been entered through the input unit. The arithmetic and logic unit 
(ALU) performs the calculations and contains the decision mechanisms of the computer, d) False. 
Software systems called operating systems manage the transition between jobs; in single-user batch 
Processing, the computer runs a single program at a time while processing data in batches. e) False. 
Assemblers convert assembly-language programs to machine language at computer speeds. f) False. 
Interpreter programs can directly execute high-level language programs without compiling them into 
machine language. g) True. h) False. Unlike other programming languages, Python is extensible. 
i) True. j) False. Several Tkinter components include Label, Button, Entry, Checkbutton 
and Radiobutton. 

EXERCISES 

1.3 Categorize each of the following items as either hardware or Software: 

a) CPU. 

b) ALU. 

c) Input unit. 

d) A word-processor program. 

e) Python modules. 

1.4 Translator programs, such as assemblers and compilers, convert programs from one language 
(referred to as the source language) to another language (referred to as the object language). Deter- 
mine which of the following statements are true and which are false: 

a) A compiler translates high-level language programs into object language. 

b) An assembler translates source-language programs into machine-language programs. 

c) A compiler converts source-language programs into object-language programs. 

d) High-level languages are generally machine dependent. 

e) A machine-language program requires translation before it can be run on a computer. 

1.5 Fili in the blanks in each of the following statements: 

a) Python can provide information about itself, a technique called_. 

b) A computer program that converts assembly-language programs to machine language 

programs is called_. 

c) The logical unit of the computer that receives information from outside the computer for 

use by the computer is called_. 

d) The process of instructing the computer to solve specific problems is called_. 

e) Three high-level Python data types are:_,_and_. 

f) _is the logical unit of the computer that sends information that has already 

been processed by the computer to various devices so that the information may be used 
outside the computer. 

g) The general name for a program that converts programs written in a certain computer lan¬ 
guage into machine language is_. 

1.6 Fili in the blanks in each of the following statements: 

a) _is the logical unit of the computer that retains information. 

b) _is the logical unit of the computer that makes logical decisions. 

c) The commonly used abbreviation for the computer's control unit is_. 

d) The level of computer language most convenient to the programmer for writing programs 

quickly and easily is_. 

e) _are “mappable” types—keys are stored with their associated values. 
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1.7 


f) The only language that a computer can understand directly is called that computer's 


is the logical unit of the computer that coordinates the activities of all 


g) The 


the other logical units. 

What do each of the following acronyms stand for: 

a) W3C. 

b) XML. 

c) DB-API. 

d) CGI. 

e) XHTML. 

f) TCP/IP. 

g) PSP. 

h) Tcl/Tk. 

i) SSL. 

j) HMD. 

State whether each of the following is true or false. If false, explain your answer. 

a) Inheritance is a form of Software reusability in which new classes are developed quickly 
and easily by absorbing the capabilities of existing classes and adding appropriate new 
capabilities. 

b) Pmw is a module that provides an interface to the popular Tcl/Tk graphical-user-interface 
toolkit. 

c) Like other high-level languages, Python is generally considered to be machine-indepen- 


1.7 


dent. 
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Introduction to Python 
Programming 




Objectives 

• To understand a typical Python program-development 
environment. 

• To write simple computer programs in Python. 

• To use simple input and output statements. 

• To become familiar with fundamental data types. 

• To use arithmetic operators. 

• To understand the precedence of arithmetic operators. 

• To write simple decision-making statements. 

High thoughts must have high language. 

Aristophanes 

Our life isfrittered away by detail...Simplify, simplify. 
Henry Thoreau 
My object ali sublime 
I shall achieve in time. 

W.S. Gilbert 
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Outiine 

2.1 Introduction 

2.2 First Program in Python: Printing a Une oflext 

2.3 Modifying our First Python Program 

2.3.1 Displaying a Single Une oflextwith Multiple Statements 

2.3.2 Displaying Multiple Unes oflext with a Single Statement 

2.4 Another Python Program: Adding Integeis 

2.5 Memory Concepts 

2.6 Arithmetic 

2.7 String Formatting 

2.8 Decision Making: Equality and Relational Operators 

2.9 Indentation 

2.10 Ihinking AboutObjects: Introduction to ObjectTechnology 

Summary • Terminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 




2.1 Introduction 

Python facilitates a disciplined approach to computer-program design. In this first pro¬ 
gramming chapter, we introduce Python programming and present several examples that 
illustrate important features of the language. To understand each example, we analyze the 
code one statement at a time. After presenting basic concepts in this chapter, we examine 
the structured programming approach in Chapters 3-5. At the same time that we explore 
introductory Python topics, we also begin our discussion of object-oriented program¬ 
ming—the key programming methodology presented throughout this text. For this reason, 
we conclude this chapter with Section 2.10, Thinking About Objects. 


2.2 First Program in fython: Printing a Line oflext 1 

We begin by considering a simple program that prints a line of text. Figure 2.1 illustrates 
the program and its screen output. 


1 # Fig. 2.1: fig02_01.py 

2 # Printing a line of text in Python. 

3 

4 print "Welcome to Python!" 


Welcome to Python! 


Fig. 2.1 Text-printing program. 


1. The resources for this book, including step-by-step instructions for installing Python on Windows 
and Unix/Linux platforms, are posted at www. deitel. com. 
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This program illustrates severat important features of the Python language. Let us con- 
sider each line of the program. Each program we present in this book has line numbers 
included for the reader’s convenience; line numbers are not part of actual Python programs. 
Line 4 does the “real work” of the program, namely displaying the phrase Welcome to 
Python ! on the screen. However, let us consider each line in order. 

Lines 1-2 begin with the pound Symbol (#), which indicates that the remainder of each 
line is a comment. Programmers insert comments to document programs and to improve 
program readability. Comments also help other programmers read and understand your 
program. Comments do not cause the computer to perform any action when the program is 
run—Python ignores comments. We begin every program with a comment indicating the 
figure number and the file name in which that program is stored (line 1). We can place any 
text we choose in comments. All of the Python programs for this book are included on the 
enclosed CD and also are available free for download at www.deitel. com. 

A comment that begins with # is called a single-line comment , because the comment 
terminates at the end of the current line. A # comment also can begin in the middle of a line 
and continue until the end of that line. Such a comment typically documents the Python 
code that appears at the beginning of that line. Unlike other programming languages, 
Python does not have a separate Symbol for a multiple-line comment, so each line of mul- 
tiple-line comment must start with the # Symbol. The comment text “Printing a line 
of text in Python.” describes the purpose of the program (line 2). 



Good Programming Practice 2.1 

Place abundant comments throughout a program. Comments help other programmers un¬ 
derstand the program, assist in debugging a program (i. e., discovering and removing errors 
in a program) and list useful Information. Comments also help you understand your pro¬ 
grams when you revisit the code for modifications or updates. 



Good Programming Practice 2.2 

Every program should begin with a comment describing the purpose ofthe program. 


Line 3 is simply a blank line. Programmers use blank lines and space characters to 
make programs easier to read. Together, blank lines, space characters and tab characters are 
known as white space. (Space characters and tabs are known specifically as white-space 
characters.) Blank lines are ignored by Python. 



Good Programming Practice 2.3 

Use blank lines to enhance program readability. 


The Python print command (line 4) instructs the computer to display the string of 
characters contained between the quotation marks. A string is a sequence of characters con- 
tained inside double quotes. The entire line is called a statement. In some programming lan¬ 
guages, like C++ and Java, statements must end with a semicolon. In Python, most 
statements simply end when the lines on which they are written end. When the statement 
on line 4 executes, it displays the message Welcome to Python! on the screen. Note 
that the double quotes that delineate the string do not appear in the output. 

Output (i.e., displaying information) and input (i.e., receiving information) in Python 
are accomplished with streams of characters. When the preceding statement executes, it 
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sends the stream of characters Welcome to Python! to the Standard output stream. The 
Standard output stream is the channel through which an application presents information to 
the user—this information typically is displayed on the screen, but may be printed on a 
printer, written to a file, etc. It may even be spoken or issued to braille devices, so users 
with visual impairments can receive the outputs. 

Python statements can be executed two ways. The first is by typing statements into an 
editor to create a program and saving the file with a .py extension (as in Fig. 2.1). Python 
files typically end with . py, although other extensions (e.g., . pyw on Windows) can be used. 
To use the Python interpreter to execute (run) the program in the file, type 

python file. py 

at the DOS or Unix shell command line , in which file. py is the name of the Python file. 
The shell command line is a text “terminal” in which the user can type commands that cause 
the computer system to respond. [Note: To invoke Python, the system path variable must 
be set properly to include the python executable —a file containing the Python interpreter 
program that can be run. The resources for this book—posted at our Web site www. dei - 
tel. com—include instructions on how to set the appropriate system path variable.] 

When the Python interpreter runs a program stored in the file, the interpreter starts at 
the first line of the file and executes statements until the end of the file. The output box in 
Fig. 2.1 contains the results of the Python interpreter running f ig02_01 .py. 

The second way to execute Python statements is interactively. Typing 

python 

at the shell command line runs the Python interpreter in interactive mode. With this mode, 
the programmer types statements directly to the interpreter, which executes these state¬ 
ments one at a time. 



Testing and Debugging Tip 2.1 

In interactive mode, Python statements are entered and interpreted one at a time. This mode 
often is useful when debugging a program. 



Testing and Debugging Tip 2.2 

When the Python interpreter is invoked on a file, the interpreter exits after the last statement 
in the file executes. However, invoking the interpreter on a file using the -iflag (for exam- 
ple, python - i file. py) causes the interpreter to enter interactive mode after executing 
the statements in the file. This is useful when debugging a program. 


Figure 2.2 shows Python 2.2 running in interactive mode on Windows. The first three 
lines display information about the version of Python being used (2.2b2 means “version 2.2 
beta 2”). The fourth line contains the Python prompt (>>>). When a programmer types a 
statement at the Python prompt and presses the Enter key (sometimes labeled the Return 
key), the interpreter executes the statement. 

The print statement on the fifth line of Fig. 2.2 displays the text Welcome to 
Python ! to the screen (note, again, that the double quotes delineating the screen do not 
print). After printing the text to the screen, the interpreter waits for the user to enter the next 
statement. We exit interactive mode by typing the Ctrl-Z end-of-file character (on 
Microsoft Windows systems) and pressing the Enter key. Figure 2.3 lists the keyboard 
combinations for the end-of-file character for various computer systems. 
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Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 
win32 

Type "help", "Copyright", "credits" or "license" for more 
information. 

>>> print "Welcome to Python!" 

Welcome to Python! 

>>> 


Fig.2.2 Interactive mode. (Python interpreter Software Copyright ©2001 Python 


Software Foundation.) 


2.3 Modifying ourfiist Python Rogram 


This section continues our introduction to Python programming with two examples that 
modify Fig. 2.1 to display text on one line using multiple statements and to display text on 
several lines using a single statement. 

2.3.1 Displaying a Single Une of Text with Multiple Statements 

Welcome to Python! can be printed in several ways. For example, Fig. 2.4 uses two 
print statements (lines 4-5), yet produces the same output as the program in Fig. 2.1. 
Most of the program is identical to that of Fig. 2.1, so we discuss only the changes here. 


Line 4 displays the string "Welcome ". Normally, after the print statement displays 
its string, Python begins a new line—subsequent outputs are displayed on the line or lines 
that follow the print statement’s string. However, the comma (,) at the end of line 4 telis 
Python not to begin a new line but instead to add a space after the string; thus, the next string 
the program displays (line 5) appears on the same line as the string "Welcome". 


C omputer System 

Key boa rd combination 

UNIX/Linux systems 

DOS/Windows 

Macintosh 

Ctrl-D (on a line by itself) 

Ctrl-Z (sometimes followed by pressing Enter) 

Ctrl-D 


Fig. 2.3 End-of-file key combinationsfor various popular computer Systems. 


1 # Fig. 2.4: fig02_04.py 

2 # Printing a line with multiple statements. 

3 

4 print , 

5 print " to Python!" 


Welcome to Python! 







Fig. 2.4 Printing one line using several print statements 
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2.3.2 Displaying Multiple Lines of Text with a Single Sta te me nt 

A single statement can display multiple lines using newline characters. Newline characters 
are “special characters” that position the screen cursor to the beginning of the next line. 
Figure 2.5 outputs four lines of text, using newline characters to determine when to begin 
each new line. 

Most of the program is identical to those of Fig. 2.1 and Fig. 2.4, so we discuss only 
the changes here. Line 4 displays four separate lines of text to the screen. Normally, the 
characters in a string display exactly as they appear in the double quotes. Notice, however, 
that the two characters \ and n (which appear three times in line 4) do not appear in the 
output. Python offers special characters that perform certain tasks, such as backspace and 
carriage return. A special character is formed by combining the backslash (\) character, 
also called the escape character , with a letter. When a backslash exists in a string of char¬ 
acters, the backslash and the character immediately following the backslash form an escape 
sequence. An example of an escape sequence is \n, which represents the newline character. 
Each occurrence of the \n escape sequence causes the screen cursor that Controls where the 
next character will appear to move to the beginning of the next line. To print a blank line, 
simply place two newline characters back-to-back. Figure 2.6 lists other common escape 
sequences. 


1 # Fig. 2.5 

2 # Printing 

3 

4 print Velc 

fig02 05.py 

multiple lines with a single statement. 

:ome\nto\n\nPython!" 

Welcome 


to 


Python! 



Fig. 2.5 Printing multiple lines using a single print statement. 


Escape Sequence Description 

\n Newline. Move the screen cursor to the beginning of the next line. 

\t Horizontal tab. Move the screen cursor to the next tab stop. 

\r Carriage return. Move the screen cursor to the beginning of the cur¬ 

rent line; do not advance to the next line. 

\b Backspace. Move the screen cursor back one space. 

\a Alert. Sound the system bell. 

\\ Backslash. Print a backslash character. 

\ " Double quote. Print a double quote character. 

\ ' Single quote. Print a single quote character. 


Fig. 2.6 Escape sequences 
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2.4 Another Python Program: Adding Integens 

Our next program inputs two integers (whole numbers, like -22, 7 and 1024) typed by a 
user at the keyboard, computes the sum of the values and displays the resuit. This program 
invokes Python functions raw_inpu t and int to obtain the two integers. Again, the pro¬ 
gram uses the print statement to display the sum of the integers. Figure 2.7 contains the 
program and its output. 

Lines 1-2 contain comments that state the figure number, file name and the purpose of 
the program. Line 5 calls Python’s built-in function raw_input to request user input. A 
built-in function is a piece of code provided by Python that performs a task. The task is per- 
formed by calling the function —writing the function name, followed by parentheses (()). 
After performing its task, a function may return a value that represents the resuit of the task. 
We study functions in depth in Chapter 4, where we mention many other built-in functions 
and show how programmers can create their own progrcimmer-defined functions. 

Python function raw_input takes the argument, "Enter first integer: \n" 
that requests user input. An argument is a value that a function accepts and uses to perform 
its task. In this case, function raw input accepts the “prompt” argument (that requests 
user input) and displays that prompt to the screen. In response to viewing this prompt, the 
user enters a number and presses the Enter key—this sends the number to function 
raw_input in the form of a string. 

The resuit of raw_input (a string containing the characters typed by the user) is 
assigned to variable integerl using the assignment symbol , =. In Python, variables are 
more specifically referred to as objects. An object resides in the computer’s memory and 
contains information used by the program. The term object normally implies that attributes 
(data) and behaviors (methods) are associated with the object. The object’s methods use the 
attributes to perform tasks. A variable name (e.g., integerl) consists of letters, digits 
and underscores (_) and does not begin with a digit. Python is case sensitive —uppercase 
and lowercase letters are different, so al and AI are different variables. An object can have 
multiple names, called identifiers. Each identifier (or variable name) references (points to) 
the object (or variable) in memory. The statement in line 5 is normally read as “Variable 
integerl is assigned the value returned by raw_input ( "Enter first 
integer: \n" ).” The actual meaning of such a line, however, is “integerl refer¬ 
ences the value returned by raw_input ( "Enter first integer: \n" ).” 


1 

# Fig. 2. 

. 7: fig02 07.py 







2 

3 

# Simple 

addition program. 







4 

# prompt 

user for input 







5 

integerl 

= raw input( 


Lrst int( 


) 

# read 

string 

6 

7 

integerl 

= int( integerl ) 

# 

convert 

string 

to 

integer 


8 

integer2 

= raw input( 


scond ini 


) 

# read 

string 

9 

integer2 

= int( integer2 ) 

# 

convert 

string 

to 

integer 


10 









11 

sum = integerl + integer2 

# 

compute 

and assign 

sum 


12 









13 

print 

, sum 

# 

print sum 





Fig. 2.7 Addition program. (Part 1 of 2.) 
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Good Programming Practice 2.4 

Choosing meaningful variable names helps a program to be “self-documenting,” i.e., it is 
easier to understand the program simply by reading it, rather than having to read manuals 
or use excessive comments. 



Good Programming Practice 2.5 

Avoid identifiers that begin with underscores and double underscores, because the Python 
interpreter or other Python code may reserve those characters for internal use. This prevents 
names you choose from being confused with names the interpreter chooses. 


In addition to a name and value, each object has a type. An object’s type identifies the 
kind of information (e.g., integer, string, etc.) stored in the object. Integers are whole numbers 
that encompass negative numbers (-14), zero (0) and positive numbers (6). In languages like 
C++ and Java, the programmer must declare (state) the object type before using the object in 
the program. However, Python uses dynamic typing, which means that Python determines an 
object’ s type during program execution. For example, if object a is initialized to 2, then the 
object is of type “integer” (because the number 2 is an integer). Similarly, if object b is ini¬ 
tialized to "Python", then the object is of type “string.” Function raw_input returns 
values of type “string,” so the object referenced by integerl (line 5) is of type “string.” 

To perform integer addition on the value referenced by integerl, the program must 
convert the string value to an integer value. Python function int (line 6) converts a string 
or a number to an integer value and returns the new value. If we do not obtain an integer 
value for variable integerl, we will not achieve the desired results—the program would 
combine the two strings instead of adding two integers. Figure 2.8 demonstrates this with 
an interactive session. 


Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 
win32 

Type "help", "Copyright", "credits" or "license" for more informa¬ 
tion. 

>>> valuel = rawinput( "Enter an integer: " ) 

Enter an integer: 2 

>>> value2 = rawinput( "Enter an integer: " ) 

Enter an integer: 4 

>>> print valuel + value2 

24 


Fig. 2.8 Adding valuesfrom raw_input (incorrectly) without converting to 
integens (the resuit should be 6). 
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The assignment statement (line 11 of Fig. 2.7) calculates the sum of the variables 
integerl and integer2 and assigns the resuit to variable sum, using the assignment 
Symbol =. The statement is read as, “sum references the value of integerl + 
integer2.” Most calculations are performed through assignment statements. 

The + Symbol is an operator —a special Symbol that performs a specific operation. In 
this case, the + operator performs addition. The + operator is called a binary operator , 
because it has two operands (values) on which it performs its operation. In this example, 
the operands are integerl and integer2. [Note: In Python, the = Symbol is not an 
operator. Rather, it is referred to as the assignment Symbol.] 


Common Programming Error 2.1 



Trying to access a variable that has not been given a value is a run-time error. 



Good Programming Practice 2.6 

Place spaces on either side ofa binary operator or Symbol. This helps the operator or Symbol 
stand out, making the program more readable. 


Line 13 displays the string "Sum is" followed by the numerical value of variable 
sum. Items we want to output are separated by commas (,). Note that this print state¬ 
ment outputs values of different types, namely a string and an integer. 

Calculations also can be performed in output statements. We could have combined the 
statements in lines 11 and 13 into the statement 


print , integerl + integer2 

thus eliminating the need for variable sum. You should make such combinations only if 
you feel it makes your programs clearer. 


2.5 Memory Coneepts 

Variable names such as integerl, integer2 and sum actually correspond to Python 
objects. Every object has a type, a size, a value and a location in the computer’s memory. 
A program cannot change an object’s type or location. Some object types permit program- 
mers to change the object’s value. We discuss these types beginning in Chapter 5, Tuples, 
Lists and Dictionaries. 

When the addition program in Fig. 2.7, exeeutes the statement 

integerl = raw_input( ) 

Python first creates an object to hold the user-entered string and places the object into a 
memory location. The = assignment Symbol then binds (associates) the name integerl 
with the newly created object. Suppose the user enters 4 5 at the raw_input prompt. Py¬ 
thon places the string "45" into memory at a starting location to which the name 
integerl is bound, as shown in Fig. 2.9. When the statement 

integerl = int( integerl ) 

exeeutes, function int creates a new object to store the integer value 4 5. This integer ob¬ 
ject begins at a new memory location and Python binds the name integerl to this new 
memory location (Fig. 2.10). Variable integerl no longer refers to the memory location 
that contains the string value "45". 
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integerl 


"45" 


Fig. 2.9 Memory location showing value of a variable and the na me bound to 
the value. 



integerl- 


45 




Fig. 2.10 Memory location showing the name and value of a variable. 


Returning to our addition program, when the statements 


integer2 = raw_input( 
integer2 = int( integer2 ) 


) 



execute, suppose the user enters the string "72". After the program converts this value to 
the integer value 7 2 and places the value into a memory location to which integer2 is 
bound, memory appears as in Fig. 2.11. Note that the locations of these objects are not nec- 
essarily adjacent in memory. 

Once the program has obtained values for integerl and integer2, the program 
adds these values and assigns the sum to variable sum. After the statement 


sum = integerl + integer2 

performs the addition, memory appears as in Fig. 2.12. Note that the values of integerl 
and integer2 appear exactly as they did before they were used in the calculation of 
sum. These values were used, but not modified, as the computer performed the calcula¬ 
tion. Thus, when a value is read out of a memory location, the value is not changed. 



45 





72 









Fig. 2.11 Memory locationsaftervaluesfortwo variableshave been input. 
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Fig. 2.12 Memory locationsaftera calculation. 


Figure 2.13 demonstrates that each Python object has a location, a type and a value and 
that these object properties are accessed through an object’s name. This program is iden- 
tical to the program in Fig. 2.7, except that we have added statements that display the 
memory location, type and value for each object at various points in the program. 




1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 


# Fig. 2.13: fig02_13.py 

# Displaying an object's location. 



type and value. 


# prompt 

integerl 
print "i; 
integerl 
print 11 ii 


the user for input 

= raw_input( ) 

, id( integerl ), type( integerl ), integerl 
= int( integerl ) 

, id( integerl ), type( integerl ), integerl 


integer2 

print 

integer2 

print 


raw_input( ) 

, id( integer2 ), type( integer2 ), integer2 
int( integer2 ) 

, id( integer2 ), type( integer2 ), integer2 


sum = integerl + integer2 

print , id( sum ), type( sum ), sum 









Fig. 2.13 Object'slocation, type and value. 
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Line 6 prints integerl’s location, type and value after the call to raw input. 
Python function idreturns the interpreter’ s representation of the variable’s location. Func- 
tion type returns the type of the variable. We print these values again (line 8), after con- 
verting the string value in integerl to an integer value. Notice that both the type and the 
location of variable integerl change as a resuit of the statement 

integerl = int( integerl ) 

The change underscores the fact that a program cannot change a variable’s type. Instead, 
the statement causes Python to create a new integer value in a new location and assigns the 
name integerl to this location. The location to which integerl previously referred 
is no longer accessible. The remainder of the program prints the location type and value for 
variables integer2 and sum in a similar manner. 

2.6 Arithmetic 

Many programs perform arithmetic calculations. Figure2.14 summarizes the arithmetic 
operators. Note the use of various special symbols not used in algebra. The asterisk (*) in- 
dicates multiplication and the percent sign (%) is the modulus operator that we discuss 
shortly. The arithmetic operators in Fig. 2.14 are binary operators, (i.e., operators that take 
two operands). For example, the expression integerl + integer2 contains the binary 
operator + and the two operands integerl and integer2. 

Python is an evolving language, and as such, some of its features change over time. 
Starting with Python 2.2, the behavior of the / division operator will begin to change from 
“floor division” to “true division.” Floor division (sometimes called integer division ), 
divides the numerator by the denominator and returns the highest integer value that is not 
greater than the resuit. For example, dividing 7 by 4 with floor division yields 1 and 
dividing 17 by 5 with floor division yields 3. Note that any fractional part in floor division 
is simply discarded (i.e., truncated) —no rounding occurs. True division yields the precise 
floating-point (i.e., numbers with a decimal point such as 7.0,0.0975 and 100.12345) resuit 
of dividing the numerator by the denominator. For example, dividing 7 by 4 with true divi¬ 
sion yields 1.75. 


Python 

opeiation 

Arithmetic 

operator 

Algebra ic 
expression 

Python 

expression 

Addition 

+ 

f+7 

f + 7 

Subtraction 

- 

p-c 

P - c 

Multiplication 

* 

bm 

b * m 

Exponentiation 

* * 

x y 

x ** y 

Division 

/ 

/ / (new in Python 2.2) 

x/y or - orx-=-y 

y 

x/y 
x // y 

Modulus 

q, 

'o 

r mod s 

r % s 


Fig. 2.14 Arithmetic operators. 
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In prior versions, Python contained only one operator for division—the / operator. 
The behavior (i.e., floor or true division) of the operator is determined by the type of the 
operands. If the operands are both integers, the operator performs floor division. If one or 
both of the operands are floating-point numbers, the operator performs true division. 

The language designers and many programmers disliked the ambiguity of the / oper¬ 
ator and decided to create two operators for version 2.2—one for each type of division. The 
/ operator performs true division and the / / operator performs floor division. However, 
this decision could introduce errors into programs that use older versions of Python. There- 
fore, the designers came up with a compromise: Starting with Python 2.2 ali future 2.x ver¬ 
sions will include two operators, but if a program author wants to use the new behavior, the 
programmer must state their intention explicitly with the statement 

from _ future _ import division 

After Python sees this statement, the / operator performs true division and the / / operator 
performs floor division. The interactive session in Fig. 2.15 demonstrates floor division and 
true division. 

We first evaluate the expression 3 / 4 . This expression evaluates to the value 0 , 
because the default behavior of the / operator with integer operands is floor division. The 
expression 3.0 / 4.0 evaluates to 0 . 75 . In this case, we use floating-point operands, 
so the / operator performs true division. The expressions 3 // 4 and 3.0 // 4.0 
evaluate to 0 and 0.0, respectively, because the // operator always performs floor divi¬ 
sion, regardless of the types of the operands. Then, in line 13 of the interactive session, we 
change the behavior of the / operator with the special import statement. In effect, this 
statement turns on the true division behavior for operator /. Now the expression 3/4 
evaluates to 0 . 75 . [Note: In this text, we use only the default 2.2 behavior for the / oper¬ 
ator, namely floor division for integers (lines 5-6 of Fig. 2.15) and true division for 
floating-point numbers (lines 7-8 of Fig. 2.15).] 


Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 
win3 2 

Type "help", "Copyright", "credits" or "license" for more informa- 
tion. 

>>> 3/4 # floor division (default behavior) 

0 


>>> 3.0 / 4.0 # true division (floating-point operands) 

0.75 

>>> 3 // 4 # floor division (only behavior) 

0 

>>> 3.0 // 4.0 # floating-point floor division 

0.0 


>>> from _future_ import division 

>>> 3/4 # true division (new behavior) 

0.75 

>>> 3.0 / 4.0 # true division (same as before) 

0.75 


Fig. 2.15 Difference in behaviorof the / operator. 
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Portability Tip 2.1 

£m[ m In Python version 3.0 (due to be released no sooner than 2003), the / operator can perform 
only true divisiori. After the release of version 3.0, programmers need to update applications 
to compensate for the new behavior. For more information on this future change, see 

python. sourceforge.net/peps/pep-0238.html 

Python provides the modulus operator (%), which yields the remainder after integer 
division. The expression x % y yields the remainder after x is divided by y. Thus, 7 % 4 
yields 3 and 17 % 5 yields 2. This operator is most commonly used with integer operands, 
but also can be used with other arithmetic types. In later chapters, we discuss many inter- 
esting applications of the modulus operator, such as determining whether one number is a 
multiple of another. (A special case of this is determining whether a number is odd or even.) 
[Note: The modulus operator can be used with both integer and floating-point numbers.] 

Arithmetic expressions in Python must be entered into the computer in straight-line 
form. Thus, expressions such as “a divided by b” must be written as a / b, so that ali con- 
stants, variables and operators appear in a straight line. The algebraic notation 

a 

b 

is generally not acceptable to compilers or interpreters, although some special-purpose 
Software packages do exist that support more natural notation for complex mathematical 
expressions. 

Parentheses are used in Python expressions in much the same manner as in algebraic 
expressions. For example, to multiply a times the quantity b + c, we write 

a * (b + c) 

Python applies the operators in arithmetic expressions in a precise sequence deter- 
mined by the following rules of operator precedence, which are generally the same as those 
followed in algebra: 

1. Expressions contained within pairs of parentheses are evaluated first. Thus, paren¬ 
theses may force the order of evaluation to occur in any sequence desired by the 
programmer. Parentheses are said to be at the “highest level of precedence.” In 
cases of nested, or embedded, parentheses, the operators in the innermost pair of 
parentheses are applied first. 

2. Exponentiation operations are applied next. If an expression contains several ex- 
ponentiation operations, operators are applied from right to left. 

3. Multiplication, division and modulus operations are applied next. If an expression 
contains several multiplication, division and modulus operations, operators are 
applied from left to right. Multiplication, division and modulus are said to be on 
the same level of precedence. 

4. Addition and subtraction operations are applied last. If an expression contains sev¬ 
eral addition and subtraction operations, operators are applied from left to right. 
Addition and subtraction also have the same level of precedence. 
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Not all expressions with severat pairs of parentheses contain nested parentheses. For 
example, the expression 

a * (b + c) + c * (d + e) 

does not contain nested parentheses. Rather, the parentheses in this expression are said to 
be “on the same levet.” 

When we say that certain operators are applied from left to right, we are referring to 
the associativity of the operators. For example, in the expression 

a + b + c 

the addition operators (+) associate from left to right. We will see that some operators as¬ 
sociate from right to left. 

Figure2.16 summarizes these rules of operator precedence. This table will be 
expanded as additional Python operators are introduced. A complete precedence chart is 
included in the appendices. 

Now let us consider several expressions in light of the rules of operator precedence. 
Each example lists an algebraic expression and its Python equivalent. The following is an 
example of an arithmetic mean (average) of five terms: 


Algebra: 


a+b+c+d+e 
m = - 

5 


Python: m = (a + b + c + d + e) / 5 

The parentheses are required because division has higher precedence than addition 
and, hence, the division will be applied first. The entire quantity (a + b + c + d + e) is 
to be divided by 5. If the parentheses are erroneously omitted, we obtain a + b + c + d + 
e / 5, which evaluates incorrectly as 


d + Z?+c + r/+ — 

5 

The following is an example of the equation of a straight line: 

Algebra: y = mx + b 

Python: y = m * x + b 

No parentheses are required. The multiplication is applied first, because multiplication has 
a higher precedence than addition. 

The following example contains modulus (%), multiplication, division, addition and 
subtraction operations: 

Algebra: z = pr%q + w/x-y 

Python: z = p*r%q + w/ x- y 
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Operatorfs) 

Operation(s) 

Oiderof Evaluation (ftecedence) 

( ) 

Parentheses 

Evaluated first. If the parentheses are nested, the 
expression in the innermost pair is evaluated first. If 
there are several pairs of parentheses “on the same 
level” (i.e., not nested), they are evaluated left to right. 

* * 

Exponentiation 

Evaluated second. If there are several, they are evalu¬ 
ated right to left. 

* / // % 

Multiplication 

Division 

Modulus 

Evaluated third. If there are several, they are evaluated 
left to right. [Note: The // operator is new in version 
2.2] 

+ " 

Addition 

Subtraction 

Evaluated last. If there are several, they are evaluated 
left to right. 


Fig. 2.16 Precedence of arithmetic operators. 




The circled numbers under the statement indicate the order in which Python applies the 
operators. The multiplication, modulus and division are evaluated first, in left-to-right or¬ 
der (i.e., they associate from left to right) because they have higher precedence than ad- 
dition and subtraction. The addition and subtraction are applied next. These are also 
applied left to right. Once the expression has been evaluated, Python assigns the resuit to 
variable z. 

To develop a better understanding of the rules of operator precedence, consider how a 
second-degree polynomial is evaluated: 


y = 



**2+b*x + c 



The circled numbers under the statement indicate the order in which Python applies the op¬ 
erators. 

Suppose variables a, b, c and x are initialized as follows: a = 2,b = 3, c = 7 and 
x = 5. Figure 2.17 illustrates the order in which the operators are applied in the preceding 
second-degree polynomial. 

The preceding assignment statement can be parenthesized with unnecessary paren¬ 
theses, for clarity, as 


y = (a* ( x ** 2 ) ) + ( b * x ) + c 



Good Programming Practice 2.7 

As in algebra, it is acceptable to place unnecessary parentheses in an expression to make the 
expression clearer. These parentheses are called redundant parentheses. Redundant paren¬ 
theses are commonly used to group subexpressions in a large expression to make that expres¬ 
sion clearer. Breaking a large statement into a sequence of shorter, simpler statements also 
promotes clarity. 
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Step 1. 

y=2*5** 2+3*5 

+ 7 


5 ** 2 is tjp] 

(Exponentiation) 

Step 2. 

1 

y=2* 25 +3*5+7 



2 * 25 is 

(Leftmost multiplication) 

Step 3. 

1 

y= 50 +3*5+7 



3 * 5 is n 

(Multiplication before addition) 

Step 4. 

i 

y = 50 + 15 + 7 



50 + 15 is [65] 

(Leftmost addition) 

Step 5. 

1 

y = 65 + 7 



65 + 7 is fi 

(Last addition) 

Step 6. 

\ 

y = 72 

(Python assigns 7 2 to y) 


Fig. 2.17 Orderin which a second-degree polynomial isevaluated. 

2.7 Sbing Fbrmatting 

Now that we have investigated numeric values, let us tum our attention to strings. Unlike 
some other popular programming languages, Python provides strings as a built-in data type, 
thereby enabling Python programs to perform powerful text-based operations easily. We 
have already learned how to create a string by placing text inside double quotes ("). Python 
strings can be created in a variety of other ways, as Fig. 2.18 demonstrates. 

Line 4 creates a string with the familiar double-quote character ("). If we want such a 
string to print double quotes to the screen, we must use the escape sequence for the double- 
quote character (\ "), rather than the double-quote character itself. 

Strings also can be created using the single-quote character ( 1 ) as shown in line 5. If 
we want to use the double-quote character inside a string created with single quotes, we do 
not need to use the escape character. Similarly, if we want to use a single-quote character 
inside a string created with double quotes, we do not need to use the escape sequence (line 
7). However, if we want to use the single-quote character inside a string created with single 
quotes (line 6), we must use the escape sequence ( \ '). 
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1 # Fig. 2.18: fig02_18.py 

2 # Creating strings and using quote characters in strings. 

3 

4 print "This is a string with \"double quotes.V" 1 

5 print 'This is another string with "double quotes." 1 

6 print 'This is a string with \'single quotes.V' 

7 print "This is another string with ' single quotes.'" 

8 print "'"'This string has "double quotes" and 'single quot 

9 You can even do multiple lines.'""' 

lfl print '''This string also has "double" and 'single' quote 


This is a string with "double quotes." 

This is another string with "double quotes." 

This is a string with 'single quotes.' 

This is another string with 'single quotes.' 

This string has "double quotes" and 'single quotes'. 

You can even do multiple lines. 

This string also has "double" and 'single' quotes. 


Fig. 2.18 Creating Python strings. 


Python also supports triple-quoted strings (lines 8-10). Triple-quoted strings are 
useful for programs that output strings with special characters, such as quote characters. 
Single- or double-quote characters inside a triple-quoted string do not need to use the 
escape sequence. Triple-quoted strings also are used for large blocks of text, because triple- 
quoted strings can span multiple lines. We use triple-quoted strings in this book when we 
write programs that output large blocks of text for the Web. 

Python strings support simple, but powerful, output formatting. We can create strings 
that format output in several ways: 


1. Rounding floating-point values to an indicated number of decimal places. 

2. Representing floating-point numbers in exponenticil notation. 

3. Aligning a column of numbers with decimal points appearing one above the other. 

4. Right-justifying and left-justifying outputs. 

5. Inserting characters or strings at precise locations in a line of output. 

6. Displaying ali types of data with fixed-size /ze/r/ widths and precision. 


The program in Fig. 2.19 demonstrates basic string-formatting capabilities. 


1 # Fig. 2.19: fig02 19.py 

2 # String formatting. 

3 

4 integerValue = 

5 print , integerValue 

6 print % integerValue 

7 print % integerValue 

8 






Fig. 2.19 String-formatting operator%. (Parti of 2.) 
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9 

floatValue = 


10 

print , 

floatValue 

11 

print " 

% floatValue 

12 

print "Default 

% floatValue 

13 



14 

print "Right j 

% integerValue 

15 

print Left ju 

% integerValue 

16 



17 

stringValue = 


18 

print "Force e 

% integerValue 

19 

print ive di< 

% floatValue 

20 

print "Fifteen 


21 

print " 

% ( stringValue, stringValue ) 


Integer 4237 
Decimal integer 4237 
Hexadecimal integer 108d 

Float 123456.789 

Default float 123456.789000 

Default exponential 1.234568e+005 


Right justify integer 
Left justify \integer 


( 4237) 

(4237 ) 


Force eight digits in integer 00004237 
Five digits after decimal in float 123456.78900 
Fifteen and five characters allowed in string: 
(String formatti) (Strin) 


Fig. 2.19 String-formatting operator%. (Part2of 2. 


Lines 4-7 demonstrate how to represent integers in a string. Line 5 displays the value 
of variable integerValue without string formatting. The % formatting operator inserts 
the value of a variable in a string (line 6). The value to the left of the operator is a string that 
contains one or more conversion specifiers —place holders for values in the string. Each 
conversion specifier begins with a percent sign (%)—not to be confused with the % format¬ 
ting operator—and ends with a conversion-specifier symbol. Conversion-specifier Symbol 
d indicates that we want to place an integer within the current string at the specified point. 
Figure 2.20 lists several conversion-specifier symbols for use in string formatting. [Note: 
See Appendix C, Number Systems, for a discussion of numeric terminology in Fig. 2.20.] 


Conversion Specifierfymbol Meaning 


c Single character (i.e., a string of length one) or the integer rep- 

resentation of an ASCII character. 

s String or a value to be converted to a string. 






Fig. 2.20 String-formatting charactere. (Parti of 2.) 
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Conversion Specifier Symbol 

Meaning 

d 

Signed decimal integer. 

u 

Unsigned decimal integer. 

o 

Unsigned octal integer. 

X 

Unsigned hexadecimal integer (with hexadecimal digits a 
through f in lowercase letters). 

X 

Unsigned hexadecimal integer (with hexadecimal digits A 
through F in uppercase letters). 

f 

Floating-point number. 

e. E 

Floating-point number (using scientific notation). 

g.G 

Floating-point number (using least-significant digits). 


Fig. 2.20 String-formatting charactere. (Part2of 2.) 


The value to the right of the % formatting operator specifies what replaces the place- 
holders in the strings. In line 6, we specify the value integerValue to replace the %d 
placeholder in the string. Line 7 inserts the hexadecimal representation of the value 
assigned to variable integerValue into the string. 

Lines 9-12 demonstrate how to insert floating-point values in a string. The f conver- 
sion specifier acts as a place holder for a floating-point value (line 11). To the right of the 
% formatting operator, we use variable f loatValue as the value to be displayed. The e 
conversion specifier acts as a place holder for a floating-point value in exponential notation. 
Exponential notation is the computer equivalent of scientific notation used in mathematics. 
For example, the value 150.4582 is represented in scientific notation as 1.5 04 5 82 X 
10 2 and is represented in exponential notation as 1.504582E+002 by the computer. 
This notation indicates that 1.504582 is multiplied by 10 raised to the second power 
(E+002). The E stands for “exponent.” 

Lines 14-15 demonstrate string formatting with field widths. A field width is the min¬ 
imum size of a field in which a value is printed. If the field width is larger than the value 
being printed, the data is normally right-justified within the field. To use field widths, place 
an integer representing the field width between the percent sign and the conversion-speci- 
fier symbol. Line 14 right-justifies the value of variable integerValue in a field width 
of size eight. To left-justify a value, specify a negative integer as the field width (line 15). 

Lines 17-21 demonstrate string formatting with precision. Precision has different 
meaning for different data types. When used with integer conversion specifiers, precision 
indicates the minimum number of digits to be printed. If the printed value contains fewer 
digits than the specified precision, zeros are prefixed to the printed value until the total 
number of digits is equivalent to the precision. To use precision, place a decimal point (.) fol- 
lowed by an integer representing the precision between the percent sign and the conversion 
specifier. Line 18 prints the value of variable integerValue with eight digits of precision. 

When precision is used with a floating-point conversion specifier, the precision is the 
number of digits to appear after the decimal point. Line 19 prints the value of variable 
f loatValue with five digits of precision. 
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When used with a string-conversion specifier, the precision is the maximum number 
of characters to be written from the string. Line 21 prints the value of variable 
stringValue twice—once with a precision of fifteen and once with a precision of five. 
Notice that the conversion specifications are contained within parentheses. When the string 
to the left of the % formatting operator contains more than one conversion specifier, the 
value to the right of the operator must be a comma-separated sequence of values. This 
sequence is contained within parentheses and must have the same number of values as the 
string has conversion specifiers. Python constructs the string from left to right by matching 
a placeholder with the next value specified between parentheses and replacing the format¬ 
ting character with that value. 

Python strings support even more powerful string-formatting capabilities through 
string methods, which we discuss in detail in Chapter 13, Strings Manipulation and Regular 
Expressions. 


2.8 Decision Making: Equality and Relational Operators 

This section introduces a simple version of Python’s i f structure that allows a program to 
make a decision based on the truth or falsity of some condition. If the condition is met, (i.e., 
the condition is true), the statement in the body of the if structure is executed. If the con¬ 
dition is not met (i.e., the condition is false), the body statement does not execute. We will 
see an example shortly. 

Conditions in if structures can be formed with the equality operators and relational 
operators summarized in Fig. 2.21. The relational operators all have the same level of pre- 
cedence and associate from left to right. All equality operators have the same level of pre- 
cedence, which is lower than the precedence of the relational operators. The equality 
operators also associate from left to right. 


Standard algebiaic 
equality opeiatoror 
relational operator 

Python equality 

orielational 

operator 

Example 
of Python 
condition 

Meaning of 

Python condition 

Relational operators 

> 

> 

x > y 

x is greater than y 

< 

< 

x < y 

x is less than y 

> 

> = 

x >= y 

x is greater than or equal to y 

< 

< = 

>1 

n 

V 

x is less than or equal to y 

Equality operators 

= 

= = 

x == y 

x is equal to y 

* 

!=. <> 

x ! = y, 

x <> y 

x is not equal to y 


Fig. 2.21 Equality and relational operators 
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Common Programming Error 2.2 



A syntax error occurs ifany ofthe operators ==, .'=, >= and <= appears with spaces be- 
tween its pair of symbols. 


Common Programming Error 2.3 



Reversing the order ofthe pair of operators in any ofthe operators ! =, <>, >= and <= (by 
writing them as = l, x, => and = <, respectively) is a syntax error. 


Common Programming Error 2.4 



Confusing the equality operator == with the assignment Symbol = is an error. The equality 
operator should be read “is equal to ” and the assignment symbol should be read “gets, ” 
“gets the value of” or “is assigned the value of. ” Some people prefer to read the equality 
operator as “double equals. ” In Python, the assignment symbol causes a syntax error when 
used in a conditional statement. 


The following example uses six if structures to compare two user-entered numbers. 
If the condition in any of these i f structures is true, the assignment statement associated 
with that if structure executes. The user inputs two values, and the program converts the 
input values to integers and assigns them to variables numberl and number2. Then, the 
program compares the numbers and displays the results of the comparisons. Figure 2.22 
shows the program and sample executions. 








1 

# Fig. 2.22: fig02 22.py 



2 

# Compare 

integers using 

if structures, relational operators 

3 

# and equality operators 



4 





5 

print 




6 

print "the 




7 





8 

# read first string and convert 

to integer 

9 

numberl = 

raw input( 


) 

10 

numberl = 

int( numberl ) 



11 





12 

# read second string and 

convert 

to integer 

13 

number2 = 

raw input( 


) 

14 

number2 = 

int ( number2 ) 



15 





16 

if numberl 

== number2: 



17 

print 


% ( 

numberl, number2 ) 

18 





19 

if numberl 

!= number2: 



20 

print 



% ( numberl, number2 ) 

21 





22 

if numberl 

< number2: 



23 

print 


% 

( numberl, number2 ) 

24 





25 

if numberl 

> number2: 



26 

print 



% ( numberl, number2 ) 

27 






Fig.2.22 Equality and relational operators used to determine logical relationships. 
(Part 1 of 2.) 
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28 if numberl <= number2: 

29 print % ( numberl, number2 ) 

30 

31 if numberl >= number2: 

32 print % ( numberl, number2 ) 


Enter two integers, and I will teli you 
the relationships they satisfy. 

Please enter first integer: 37 
Please enter second integer: 42 
37 is not equal to 42 
37 is less than 42 
37 is less than or equal to 42 


Enter two integers, and I will teli you 
the relationships they satisfy. 

Please enter first integer: 7 
Please enter second integer: 7 
7 is equal to 7 
7 is less than or equal to 7 
7 is greater than or equal to 7 




Enter two integers, and I will teli 
the relationships they satisfy. 
Please enter first integer: 54 
Please enter second integer: 17 
54 is not equal to 17 
54 is greater than 17 
54 is greater than or equal to 17 



you 


Fig. 2.22 Equalityand relational operatoreused to determine logical relationships. 
(Part2of 2.) 


The program uses Python functions raw_input and int to input two integers (lines 
8-14). First a value is obtained for variable numberl, then a value is obtained for variable 

number2. 

The if structure in lines 16-17 compares the values of variables numberl and 
number2 to test for equality. If the values are equal, the statement displays a line of text 
indic ating that the numbers are equal (line 17). If the conditions are met in one or more of 
the if structures starting at lines 19, 22, 25,28 and 31, the corresponding print statement 
displays a line of text. 

Each if structure consists of the word if, the condition to be tested and a colon (:). 
An if structure also contains a body (called a suite). Notice that each if structure in 
Fig. 2.22 has a single statement in its body and that each body is indented. Some languages, 
like C++, Java and C# use braces, { }, to denote the body of i f structures; Python requires 
indentation for this purpose. We discuss indentation in the next section. 
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Common Programming Error 2.5 

Failure to insert a colon (:) in an if structure is a syntax error. 



Common Programming Error 2.6 

Failure to indent the body ofan if structure is a syntax error. 



Good Programming Practice 2.8 

Set a convention for the size of indent you prefer, then apply that convention uniformly. The 
tab key may create indents, but tab stops may vary. We recommend using three spaces toform 
a level of indent. 


In Python, syntax evaluation is dependent on white space; thus, the inconsistent use of 
white space can cause syntax errors. For instance, splitting a statement over multiple lines can 
resuit in a syntax emor. If a statement is long, the statement can be spread over multiple lines 
using the \ line-continuation character. Some Python interpreters use " . . . " to denote a con- 
tinuing line. The interactive session in Fig. 2.23 demonstrates the line-continuation character. 



Good Programming Practice 2.9 

A lengthy statement may be spread over several lines with the \ continuation character. Ifa 
single statement must be split across lines, choose breaking points that make sense, such as 
after a comma in a print statement or after an operator in a lengthy expression. 


Figure 2.24 shows the precedence of the operators introduced in this chapter. The oper- 
ators are shown from top to bottom in decreasing order of precedence. Notice that all these 
operators, except exponentiation, associate from left to right. 



Testing and Debugging Tip 2.3 

Refer to the operator-precedence chart when writing expressioris containing many opera¬ 
tors. Confirm that the operators in the expression are performed in the order you expect. If 
you are uncertain about the order of evaluation in a complex expression, break the expres¬ 
sion into smaller statements or use parentheses toforce the order, exactly as you would do 
in an algebraic expression. Be sure to obser\>e that some operators, such as exponentiation 
(**), associate from right to left rather thanfrom left to right. 


Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 
win32 

Type "help", "Copyright", "credits" or "license" for more informa- 
tion. 

>>> print 1 + 

File "<string>", line 1 
print 1 + 

A. 

SyntaxError: invalid syntax 
>>> print 1 + \ 

... 2 
3 

>>> 


Fig. 2.23 Line-continuation (\) character. 
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O perato ts 



Assoc iativity 

Type 

() 



left to right 

parentheses 

* * 



right to left 

exponenti al 

* / 

// 

% 

left to right 

multiplicative 

+ 



left to right 

additive 

< < = 

> 

>= 

left to right 

relational 

= = ! = 

<> 


left to right 

equality 


Fig. 2.24 Precedence and associativityof ope rato rsdiscussed so far. 


2.9 Indentation 


Python uses indentation to delimit (distinguish) sections of code. Other programming lan- 
guages often use braces to delimit sections of code. A suite is a section of code that corre- 
sponds to the body of a control structure. We study blocks in the next chapter. The Python 
programmer chooses the number of spaces to indent a suite or block, and the number of 
spaces must remain consistent for each statement in the suite or block. Python recognizes 
new suites or blocks when there is a change in the number of indented spaces. 


Common Programming Error 2.7 



Ifa single section of code contains Unes ofcode that are not uniformly indented, the Python 
interpreter reads those lines as belonging to other sections, causing syntax or logic errors. 


Figure 2.25 contains a modified version of the code in Fig. 2.22 to illustrate improper 
indentation. Lines 21-22 show the improper indentation of an if statement. Even though 
the program does not produce an error, it skips an equality operator. The 

if numberl != number2: 

statement (line 21) executes only if the if numberl == number2 : statement (line 16) 
executes. In this case, the if statement in line 21 never executes, because two equal num- 
bers will never be unequal (i.e., 2 will never unequal 2). Thus, the output of Fig. 2.25 does 
not state that 1 is not equal to 2 as it should. 


1 # Fig. 2.25: fig02 25.py 

2 # Using if statements, relational operators and equality 

3 # operators to show improper indentation. 

4 

5 print "Enter two integers, and I will teli you" 

6 print "the relationships they satisfy." 

7 

8 # read first string and convert to integer 

9 numberl = raw_input ( ) 

10 numberl = int( numberl ) 

11 








Fig. 2.25 if statementsused to show improperindentation. (Part 1 of 2.) 
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12 # read second string and convert 

to integer 

13 number2 = raw input ( 

) 

14 mimber2 = int ( number2 ) 


15 



16 if 

numberl == number2 : 


17 

print % ( 

numberl, number2 ) 

18 



19 

# improper indentation causes 

this if statement to execute only 

20 

# when the above if statement 

executes 

21 

if numberl != number2: 


22 

print "%d is not equal to 

% ( numberl, number2 ) 

23 



24 if 

numberl < number2 : 


25 

print % 

( numberl, number2 ) 

26 



27 if 

numberl > number2 : 


28 

print "%d is greater than %d M 

% ( numberl, number2 ) 

29 



30 if 

numberl <= number2 : 


31 

print "%d is less than or equ 

% ( numberl, number2 ) 

32 



33 if 

numberl >= number2 : 


34 

print "%d is greater than or e 

% ( numberl, number2 ) 

Enter 

two integers, and I will teli 

you 

the relationships they satisfy. 


Please 

enter first integer: 1 


Please 

enter second integer: 2 


1 is less than 2 


1 is less than or equal to 2 


Fig. 2.25 

if statementsused to show improper indentation. (Part 2 of 2.) 


Testing and Debugging Tip 2.4 



| To avoid subtle errors, ensure consistent andproper indentation within a Python program. 


2.10 Ihinking About Objecte: Introduction to Object 
Technology 

In each of the first six chapters, we concentrate on the “conventional” methodology of 
structured programming, because the objects we will build will be composed in part of 
structured-program pieces. Now we begin our early introduction to object orientation. In 
this section, we will see that object orientation is a natural way of thinking about the world 
and of writing computer programs. 

We begin our introduction to object orientation with some key concepts and termi- 
nology. First, look around you in the real world. Everywhere you look you see them— 
objectsl —people, animals, plants, cars, planes, buildings, computers, etc. Humans think in 
terms of objects. We have the marvelous ability of abstraction that enables us to view 
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images on a computer screen as objects such as people, planes, trees and mountains, rather 
than as individual dots of color. We can, if we wish, think in terms of beaches rather than 
grains of sand, forests rather than trees and buildings rather than bricks. 

We might be inclined to divide objects into two categories—animate objects and inan¬ 
imate objects. Animate objects are “alive” in some sense. They move around and do things. 
Inanimate objects, like towels, seem not to do much at ali. They just “sit around.” Ali these 
objects, however, do have some things in common. They all have attributes, like size, 
shape, color and weight, and they all exhibit beliaviors (e.g., a ball rolls, bounces, inflates 
and deflates; a baby cries, sleeps, crawls, walks and blinks; a car accelerates, brakes and 
turns; a towel absorbs water). 

Humans leam about objects by studying their attributes and observing their behaviors. 
Different objects can have similar attributes and can exhibit similar behaviors. Compari- 
sons can be made, for example, between babies and adults and between humans and chim- 
panzees. Cars, trucks, little red wagons and roller skates have much in common. 

Object-Oriented programming (OOP) models real-world objects using Software coun- 
terparts. It takes advantage of class relationships, where objects of a certain class—such as 
a class of vehicles—have the same characteristics. It takes advantage of inheritance rela¬ 
tionships, and even multiple inheritance relationships, where newly created classes of 
objects are derived by absorbing characteristics of existing classes and adding unique char¬ 
acteristics of their own. An object of class “convertible” certainly has the characteristics of 
the more general class “automobile,” but a convertible’ s roof goes up and down. 

Object-Oriented programming gives us a more natural and intuitive way to view the 
programming process, by modeling real-world objects, their attributes and their behaviors. 
OOP also models Communications between objects. Just as people send messages to one 
another (e.g., a sergeant commanding a soldier to stand at attention), objects communicate 
via messages. 

OOP encapsulates data (attributes) and functions (behavior) into packages called 
objects; the data and functions of an object are intimately tied together. Objects have the 
property of information hiding. This means that, although objects may know how to com¬ 
municate with one another, objects normally are not allowed to know how other objects are 
implemented—implementation details are hidden within the objects themselves. Surely it 
is possible to drive a car effectively without knowing the details of how engines, transmis- 
sions and exhaust systems work internally. We will see why information hiding is so crucial 
to good Software engineering. 

In C and other procedural programming languages, programming tends to be action- 
oriented; in Python, programming is object-oriented (ideally). The function is the unit of 
programming in procedural programming. In object-oriented programming, the unit of pro¬ 
gramming is the class from which objects are eventually instantiated (a fancy term for “cre¬ 
ated”). Python classes contain functions (that implement class behaviors) and data (that 
implements class attributes). 

Procedural programmers concentrate on writing functions. Groups of actions that per- 
form some task are formed into functions, and functions are grouped to form programs. 
Data is certainly important in procedural programming, but the view is that data exists pri- 
marily in support of the actions that functions perform. The verbs in a system specification 
help the procedural programmer determine the set of functions that will work together to 
implement the system. 
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Object-Oriented programmers concentrate on creating their own user-defined types 
called classes. Each class contains both data and the set of functions that manipulate the 
data. The data components of a class are called data members or attributes. The functional 
components of a class are called methods (or memberfunctions in other object-oriented lan- 
guages). The focus of attention in object-oriented programming is on classes rather than 
functions. The nouns in a system specification help the object-oriented programmer deter- 
mine the set of classes that will be used to create the instances that will work together to 
implement the system. 

Classes are to objects as blueprints are to houses. We can build many houses from one 
blueprint, and we can create many objects from one class. Classes can also have relation- 
ships with other classes. For example, in an object-oriented design of a bank, the Bank- 
Teller class needs to relate to the Customer class. These relationships are called 
associations. 

We will see that, when Software is packaged as classes, these classes can be reused in 
future Software systems. Groups of related classes are often packaged as reusable compo¬ 
nents or modules. Just as real-estate brokers teli their clients that the three most important 
factors affecting the price of real estate are “location, location and location,” we believe the 
three most important factors affecting the future of Software development are “reuse, reuse 
and reuse.” 

Indeed, with object technology, we will build most future Software by combining “stan- 
dardized, interchangeable parts” called components. This book will teach you how to “craft 
valuable classes” for reuse, reuse and reuse. Each new class you create will have the potential 
to become a valuable Software asset that you and other programmers can use to speed and 
enhance the quality of future software-development efforts. This is an exciting possibility. 

In this chapter, we have introduced many important features of Python, including 
printing data on the screen, inputting data from the keyboard, performing calculations and 
making decisions. In Chapter 3, Control Structures, we build on these techniques as we 
introduce structured programming. We will study how to specify and vary the order in 
which statements are executed—this order is called flow of control. Also, we introduced the 
basic concepts and terminology of object orientation. In Chapters 7-9, we expand our dis- 
cussion on object-oriented programming. 

SUMMARY 

• Programmers insert comments to document programs and to improve program readability. Com- 
ments also help other programmers read and understand your program. In Python, comments are 
denoted by the pound Symbol (#). 

• A comment that begins with # is called a single-line comment, because the comment terminates 
at the end of the current line. 

• Comments do not cause the computer to perform any action when the program is run. Python ig¬ 
nores comments. 

• Programmers use blank lines and space characters to make programs easier to read. Together, 
blank lines, space characters and tab characters are known as white space. (Space characters and 
tabs are known specifically as white-space characters.) 

• Blank lines are ignored by Python. 

• The Standard output stream is the channel by which information presented to the user by an appli- 
cation—this information typically is displayed on the screen, but may be printed on a printer, writ- 
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ten to a file, ete. It may even be spoken or issued to braille devices, so users with visual 
impairments can receive the outputs. 

• The print statement instructs the computer to display the string of characters contained between 
the quotation marks. A string is a Python data type that contains a sequence of characters. 

• A print statement normally sends a newline character to the screen. After a newline character is 
sent, the next string displayed on the screen appears on the line below the previous string. Howev- 
er, a comma (,) telis Python not to send the newline character to the screen. Instead, Python adds 
a space after the string, and the next string printed to the screen appears on the same line. 

• Output (i.e., displaying informationi and input (i.e., receiving information) in Python are accom- 
plished with streams of characters. 

• Python files typically end with .py, although other extensions (e.g., .pyw on Windows) can be 
used. 

• When the Python interpreter executes a program, the interpreter starts at the first line of the file 
and executes statements until the end of the file. 

• The backslash (\) is an escape character. It indicates that a “special” character is to be output. 
When a backslash is encountered in a string of characters, the next character is combined with the 
backslash to form an escape sequence. 

• The escape sequence \n means newline. Each occurrence of a \n (newline) escape sequence caus- 
es the screen cursor to position to the beginning of the next line. 

• A built-in function is a piece of code provided by Python that performs a task. The task is per- 
formed when the function is invoked or called. After performing its task, a function may return a 
value that represents the end resuit of the task. 

• In Python, variables are more specifically referred to as objects. An object resides in the comput¬ 
er’s memory and contains information used by the program. The term object normally implies that 
attributes (data) and behaviors (methods) are associated with the object. The object’s methods use 
the attributes to perform tasks. 

• A variable name consists of letters, digits and underscores (_) and does not begin with a digit. 

• Python is case sensitive—uppercase and lowercase letters are different, so al and AI are different 
variables. 

• An object can have multiple names, called identifiers. Each identifier (or variable name) referenc- 
es (points to) the object (or variable) in memory. 

• Each object has a type. An object’s type identifies the kind of information (e.g., integer, string, 
etc.) stored in the object. 

• In Python, every object has a type, a size, a value and a location. 

• Function type returns the type of an object. Function id returns a number that represents the ob¬ 
ject’s location. 

• In languages like C++ and Java, the programmer must declare the object type before using the ob¬ 
ject in the program. In Python, the type of an object is determined automatically, as the program 
executes. This approach is called dynamic typing. 

• Binary operators take two operands. Examples of binary operators are + and -. 

• Starting with Python version 2.2, the behavior of the / division operator will change from “floor 
division” to “true division.” 

• Floor division (sometimes called integer division), divides the numerator by the denominator and 
returns the highest integer value that is not greater than the resuit. Any fractional part in floor di¬ 
vision is simply discarded (i.e., truncated)—no rounding occurs. 
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• True division yields the precise floating-point resuit of dividing the numerator by the denominator. 

• The behavior (i.e., floor or true division) of the / operator is determined by the type of the oper- 
ands. If the operands are both integers, the operator performs floor division. If one or both of the 
operands are floating-point numbers, the operator perform true division. 

• The / / operator performs floor division. 

• Programmers can change the behavior of the / operator to perform true division with the statement 

from_future_import division. 

• In Python version 3.0, the only behavior of the / operator will be true division. After the release 
of version 3.0, ali programs are expected to have been updated to compensate for the new be¬ 
havior. 

• Python provides the modulus operator (%), which yields the remainder after integer division. The 
expression x % y yields the remainder after x is divided by y. Thus, 7 % 4 yields 3 and 17 % 5 
yields 2. This operator is most commonly used with integer operands, but also can be used with 
other arithmetic types. 

• The modulus operator can be used with both integer and floating-point numbers. 

• Arithmetic expressions in Python rnust be entered into the computer in straight-line form. Thus, 
expressions such as “a divided by b” must be written as a / b, so that ali constants, variables and 
operators appear in a straight line. 

• Parentheses are used in Python expressions in much the same manner as in algebraic expressions. 
For example, to multiply a times the quantity b + c, we write a * (b + c) . 

• Python applies operators in arithmetic expressions in a precise sequence determined by the rules 
of operator precedence, which are generally the same as those followed in algebra. 

• When we say that certain operators are applied from left to right, we are referring to the associa¬ 
ti vity of the operators. 

• Python provides strings as a built-in data type and can perform powerful text-based operations. 

• Strings canbe created using the single-quote ( 1 ) and double-quote characters ("). Python also sup- 
ports triple-quoted strings. Triple-quoted strings are useful for programs that output strings with 
quote characters or large blocks of text. Single- or double-quote charactere inside a triple-quoted 
string do not need to use the escape sequence, and triple-quoted strings can span multiple lines. 

• A field width is the minimum size of a field in which a value is printed. If the field width is larger 
than that needed by the value being printed, the data normally is right-justified within the field. To 
use field widths, place an integer representing the field width between the percent sign and the con- 
version-specifier Symbol. 

• Precision has different meaning for different data types. When used with integer conversion spec- 
ifiers, precision indicates the minimum number of digits to be printed. If the printed value contains 
fewer digits than the specified precision, zeros are prefixed to the printed value until the total num¬ 
ber of digits is equivalent to the precision. 

• When used with a floating-point conversion specifier, the precision is the number of digits to ap¬ 
pear to the right of the decimal point. 

• When used with a string-conversion specifier, the precision is the maximum number of characters 
to be written from the string. 

• Exponential notation is the computer equivalent of scientific notation used in mathematics. For ex¬ 
ample, the value 150.4582 is represented in scientific notation as 1. 504582 X 10 2 and is rep¬ 
resented in exponential notation as 1.504582E+002 by the computer. This notation indicates 
that 1.504582 is multiplied by 10 raised to the second power (E+0 02). The E stands for “ex¬ 
ponent.” 
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• An if structure allows a program to make a decision based on the truth or falsity of a condition. 
If the condition is true, (i.e., the condition is met), the statement in the body of the if structure is 
executed. If the condition is not met, the body statement is not executed. 

• Conditions in if structures can be formed with equality relational operators. The relational oper- 
ators all have the same level of precedence and associate from left to right. The equality operators 
both have the same level of precedence, which is lower than the precedence of the relational op¬ 
erators. The equality operators also associate from left to right. 

• Each if structure consists of the word if, the condition to be tested and a colon (:). An if struc¬ 
ture also contains a body (called a suite). 

• Python uses indentation to delimit (distinguish) sections of code. Other programming languages 
often use braces to delimit sections of code. A suite is a section of code that corresponds to the 
body of a control structure. We study blocks in the next chapter. 

• The Python programmer chooses the number of spaces to indent a suite or block, and the number 
of spaces must remain consistent for each statement in the suite or block. 

• Splitting a statement over two lines can also cause a syntax error. If a statement is long, the state¬ 
ment can be spread over multiple lines using the \ line-continuation character. 

• Object-Oriented programming (OOP) models real-world objects with Software counterparts. It 
takes advantage of class relationships where objects of a certain class—such as a class of vehi- 
cles—have the same characteristics. 

• OOP takes advantage of inheritance relationships, and even multiple-inheritance relationships, 
where newly created classes of objects are derived by absorbing characteristics of existing classes 
and adding unique characteristics of their own. 

• Object-Oriented programming gives us a more natural and intuitive way to view the programming 
process, namely, by modeling real-world objects, their attributes and their behaviors. OOP also 
models communication between objects. 

• OOP encapsulates data (attributes) and functions (behavior) into packages called objects; the data 
and functions of an object are intimately tied together. 

• Objects have the property of information hiding. Although objects may know how to communicate 
with one another across well-defined interfaces, objects normally are not allowed to know how 
other objects are implemented—implementation details are hidden within the objects themselves. 

• In Python, programming can be object-oriented. In object-oriented programming, the unit of pro¬ 
gramming is the class from which instances are eventually created. Python classes contain meth- 
ods (that implement class behaviors) and data (that implements class attributes). 

• Object-oriented programmers create their own user-defined types called classes and components. 
Each class contains both data and the set of functions that manipulate the data. The data compo¬ 
nents of a class are called data members or attributes. 

• The functional components of a class are called methods (or member functions, in some other ob¬ 
ject-oriented languages). 

• The focus of attention in object-oriented programming is on classes rather than on functions. The 
nouns in a systeni specification help the object-oriented programmer determine the set of classes 
that will be used to create the instances that will work together to implement the system. 


TERMINOLOGY 


abstraction 

alert escape sequence (\a) 
argument 


arithmetic operator 
assignment statement 
assignment Symbol (=) 
































pythonhtpl_02.fm Page 65 Wednesday, December 12, 2001 


12:12 PM 






Chapter 2 


Introduction to Python Programming 65 




association 

memory location 

associativity 

method 

associativity of operators 

modeling 

asterisk (*) 

modulus 

attribute 

modulus operator (%) 

backslash (\) escape sequence 

multiple inheritance 

backspace (\b) 

newline character (\n) 

behavior 

object 

binary operator 

object orientation 

block 

OOP (object-oriented programming) 

built-in function 

operand 

calculation 

operator overloading 

calling a function 

operator precedence 

carriage return (\r) 

overloading 

case sensitive 

percent sign (%) 

class 

polynomial 

comma-separated list 

precedence 

comment 

precision 

component 

procedural programming language 

condition 

pseudocode 

conversion specifier 

. py extension 

data member 

. pyw extension 

debugging 

raw input function 

design 

readability 

dynamic typing 

redundant parentheses 

embedded parentheses 

relational operator 

encapsulation 

reused class 

equality operators 

right justify 

escape character 

scientific notation 

escape sequence 

screen output 

execute 

second-degree polynomial 

exponential notation 

self-documentation 

exponentiation 

single-line comment 

field width 

single quote 

floating-point division 

Software asset 

floor division 

Standard output stream 

flow of control 

statement 

function 

stream of characters 

id function 

string of characters 

identifier 

string type 

indentation 

structured programming 

information hiding 

suite 

inheritance 

system path variable 

instance 

triple-quoted string 

int function 

true division 

integer division 

truncate 

left justify 

type 

left-to-right evaluation 

type function 

member function 

user-deftned type 

memory 
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SELF-REVIEW EXERCISES 

2.1 Fili in the blanks in each of the following: 

a) The_statement instructs the computer to display information on the screen. 

b) A_is a Python data type that contains a sequence of characters. 

c) _are simply nantes that reference objects. 

d) The_is the modulus operator. 

e) _are used to document a program and improve its readability. 

f) Each if structure consists of the word_, the _to be tested, a 

_and a_. 

g) The_function converts non-integer values to integer values. 

h) A Python statement can be spread over multiple lines using the_. 

i) Arithmetic expressions enclosed in_are evaluated first. 

j) An object’s_describes the information stored in the object. 

2.2 State whether each of the following is true or false. If false, explain why. 

a) The Python function get_input requests input from the user. 

b) A valid Python arithmetic expression with no parentheses is evaluated left to right. 

c) The following are invalid variable names: 3g. 87 and 2h. 

d) The operator ! = is an example of a relational operator. 

e) A variable name identifies the kind of information stored in the object. 

f) In Python, the programmer must declare the object type before using the object in the 
program. 

g) If parentheses are nested, the expression in the innermost pair is evaluated first. 

h) Python treats the variable names, al and AI, as the same variable. 

i) The backslash character is called an escape sequence. 

j) The relational operators ali have the same level of precedence and evaluate left to right. 

ANSWERS TO SELF-REVIEW EXERCISES 

2.1 a) print. b) string. c) Identifiers. d) percent sign (%). e) Comments. f) if , condition, colon 
(:), body/suite. g) int. h) line-continuation character (\). i) parentheses, j) type. 

2.2 a) False. The Python function raw_input gets input from the user. b) False. Python arith¬ 
metic expressions are evaluated according to the rules of operator precedence and associativity—not 
left to right. c) True. d) False. The operator ! = is an example of an equality operator, e) False. An 
object type identifies the kind of information stored in the object. f) False. In Python, the object type 
is determined as the program executes. g) True. h) False. Python is case sensitive, so al and Al are 
different variables. i) False. The backslash is called an escape character, j) True. 


EXERCISES 

2.3 State the order of evaluation of the operators in each of the following Python statements and 
show the value of x after each statement is performed. 

a) x = 7+ 3*6/2-l 

b) x = 2%2 + 2*2-2/2 

c) x=(3*9* (3 + (9*3 / (3) ) ) ) 

2.4 Write a program that requests the user to enter two numbers and prints the sum, product, dif- 
ference and quotient of the two numbers. 

2.5 Write a program that reads in the radius of a circle and prints the circle’s diameter, circum- 
ference and area. Use the constant value 3.14159 for 7t. Do these calculations in output statements. 
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2.6 Write a program that prints a box, an oval, an arrow and a diamond, as shown: 


********* 


* * * 
***** 


* * 

* * 

* * 


********* 


* * 
* * 

* * 




2.7 Write a program that reads in two integers and determines and prints whether the first is a 
multiple of the second. (Hint: Use the modulus operator.) 


2.8 Give a brief answer to each of the following “object think’" questions: 

a) Why does this text choose to discuss structured programming in detail before proceeding 
with an in-depth treatment of object-oriented programming? 

b) What aspects of an object need to be determined before an object-oriented program can 
be built? 

c) How is inheritance exhibited by human beings? 

d) What kinds of messages do people send to one another? 

e) Objects send messages to one another across well-defined interfaces. What interfaces 
does a car radio (object) present to its user (a person object)? 
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Objectives 

• To understand basic problem-solving techniques. 

• To develop algorithms through the process of top- 
down, stepwise refinement. 

• To use the if, if/else and if/elif/else 
structures to select appropriate actions. 

• To use the while and for repetition structures to 
execute statements in a program repeatedly. 

• To understand counter-controlled and sentinel- 
controlled repetition. 

• To use augmented assignment symbols and logical 
operators. 

• To use the break and continue program control 
statements. 

Let’s all move one place on. 

Lewis Carroll 

The wheel is comefull circle. 

William Shakespeare, King Lear 

Who cari control his fate? 

William Shakespeare, Othello 

The used key is always bright. 

Benjamin Franklin 





-s* 


rm 
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O uti i ne 

3.1 

Introduction 

3.2 

Algorithms 

3.3 

Rseudocode 

3.4 

Control Structures 

3.5 

i £ Selection Structure 

3.6 

if/else and if/elif/else Selection Structures 

3.7 

while Repetition Structure 

3.8 

Fbrmulating Algorithms: Case Study 1 (Counter-Controlled 
Repetition) 

3.9 

Formulating Algorithms withlop-Down, Stepwise Refinement Case 
Study 2 (Sentinel-Controlled Repetition) 

3.10 

Fbrmulating Algorithms with Top-Down, Stepwise Refinement: Case 
Study 3 (Nested Control Structures) 

3.11 

Augmerrted AssignmentSymboIs 

3.12 

Esserttialsof Counter-Controlled Repetition 

3.13 

for Repetition Structure 

3.14 

Using the for Repetition Structure 

3.15 

break and continue Statemerrts 

3.16 

Logic a 1 Operators 

3.17 

Structured-Programming Summary 

Summary • Tenninology • Self-Review Exercises • Answers to Self-Review Exercises 


3.1 Introduction 


Before writing a program to solve a particular problem, it is essential to have a thorough 
understanding of the problem and a carefully planned approach to solving the problem. 
When writing a program, it is equally essential to understand the types of building blocks 
that are available and to use proven program-construction principies. In this chapter, we 
discuss these issues in our presentation of the theory and principies of structured program- 
ming. The techniques that you learn are applicable to most high-level languages, including 
Python. When we begin our treatment of object-oriented programming in Chapter 7, we use 
the control structures presented in this chapter to build and manipulate objects. 

3.2 Algorithms 

Any computing problem can be solved by executing a series of actions in a specified order. 
An algorithm is a procedure for solving a problem in terms of 

1. actions to be executed and 

2. the order in which these actions are to be executed. 
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The following example demonstrates that specifying the order in which the actions are to 
be executed is important. 

Consider the “rise-and-shine” algorithm followed by one junior executive for getting 
out of bed and going to work: (1) Get out of bed, (2) take off pajamas, (3) take a shower, 
(4) get dressed, (5) eat breakfast, (6) carpool to work. This routine gets the executive to 
work to make critical decisions. 

Suppose that the same steps are performed in a slightly different order: (1) Get out of 
bed, (2) take off pajamas, (3) get dressed, (4) take a shower, (5) eat breakfast, (6) carpool 
to work. In this case, our junior executive shows up for work soaking wet. 

Specifying the order in which statements are to be executed in a computer program is 
called program control. In this chapter, we investigate Python’s program-control capabilities. 


3.3 Pseudocode 


Pseudocode is an artificial and informal language that helps programmers develop algo- 
rithms. Pseudocode consists of descriptions of executable statements —those that are exe¬ 
cuted when the program has been converted from pseudocode to Python. The pseudocode 
we present here is useful for developing algorithms that will be converted to Python pro- 
grams. Pseudocode is similar to everyday English; it is convenient and user-friendly, al- 
though it is not an actual computer programming language. 

Pseudocode programs are not executed on computers. Rather, pseudocode helps the 
programmer “plan” a program before attempting to write it in a programming language, 
such as Python. In this chapter, we provide several examples of how pseudocode can be 
used effectively in developing Python programs. 


Pseudocode often is used to “think out” a program during the program design process. Tlien 
'-the pseudocode program is converted to Python. 


The style of pseudocode we present consists purely of characters, so programmers can 
conveniently type pseudocode programs using a text-editor program. This way, a computer 
can display a fresh copy of a pseudocode program on demand. A carefully prepared 
pseudocode program can be converted easily to a corresponding Python program. In many 
cases, this is done simply by replacing pseudocode statements with their Python equivalents. 


3.4 Control Structures 

Normally, statements in a program are executed in the order in which they are written. This 
is called sequential execution. Various Python statements enable the programmer to specify 
that the next statement to be executed may be other than the next one in sequence. This is 
called transfer of control. Transfer of control is achieved with Python control structures. 
This section discusses the background of control structure development and the specific 
tools Python uses to transfer control in a program. 

During the 1960s, it became ciear that the indiscriminate use of control transfers 
caused the difficulty experienced by software-development groups. The finger of blame 
was pointed at the goto statement (used in several programming languages, including C 
and Basic), which allows a programmer to specify a transfer of control to one of a wide 
range of possible destinations in a program. The notion of so-called structured program- 
ming became almost synonymous with “goto elimination.” 
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The research of Bohm and Jacopini 1 demonstrated that programs could be written 
without any goto statements. The challenge, then became for programmers to alter their 
programming styles to “goto-less programming.” When programmers began to take struc- 
tured programming seriously beginning in the 1970s, the notion of structured programming 
became almost synonymous with goto elimination. Since then, the results have been 
impressive, as Software development groups have reported reduced development times, 
more frequent on-time delivery of systems and more frequent within-budget completion of 
Software projects. Structured programming has enabled these improvements because struc¬ 
tured programs are clearer, easier to debug and modify and more likely to be bug-free in 
the first place. 

Bohm and Jacopini’s work demonstrated that all programs could be written in terms of 
three control structures —namely, the sequence structure, the selection structure and the 
repetition structure. The sequence structure is built into Python. Unless directed otherwise, 
the computer executes Python statements sequentially. The flowchart segment of Fig. 3.1 
illustrates a typical sequence structure in which two calculations are performed sequen¬ 
tially. A flowchart is a tool that provides graphical representation of an algorithm or a por- 
tion of an algorithm. 

Flowcharts are drawn using certain special-purpose symbols, such as rectangles, dia- 
monds, ovals and small circles; these symbols are connected by arrows called flowlines, 
which indicate the order in which the actions of the algorithm execute. Like pseudocode, 
flowcharts aid in the development and representation of algorithms. Although most pro¬ 
grammers prefer pseudocode, flowcharts illustrate clearly how control structures operate. 
The reader should carefully compare the pseudocode and flowchart representations of each 
control structure. 

The flowchart segment for the sequence structure in Fig. 3.1 uses the rectangle 
Symbol, called the action Symbol, to indicate an action, (e.g., calculation or an input/output 
operation). The flowlines in the figure indicate the order in which the actions are to be 
performed—first, grade is added to total, then 1 is added to counter. Python allows 
us to have as many actions as we want in a sequence structure—anywhere a single action 
may be placed, we can place several actions in sequence. 



add grade to total total = total + grade 


add Ito counter counter = counter + 1 


Fig. 3.1 Sequence structure flowchart. 


1. Bohm, C., and G. Jacopini, “Flow Diagrams, Turing Machines, and Languages with Only Two 
Formation Rules,” Communications of the ACM, Vol. 9, No. 5, May 1966, pp. 336-371. 
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In a flowchart that represents a complete algorithm, an oval Symbol containing the word 
“Begin” represents the start of the flowchart; an oval Symbol containing the word “End” rep¬ 
resents the end of the flowchart. When drawing a portion of an algorithm, as in Fig. 3.1, the 
oval symbols are omitted in favor of small circle symbols, also called connector symbols. 

Perhaps the most important flowchart Symbol is the diamond Symbol, also called the 
decision Symbol, which indicates a decision is to be made. We discuss the diamond Symbol 
in the next section. The pseudocode we present here is useful for developing algorithms that 
will be converted to structured Python programs. 

Python provides three types of selection structures: if, if/else and if/elif/ 
else. We discuss each of these in this chapter. The if selection structure either performs 
(selects) an action if a condition (predicate) is true or skips the action if the condition is 
false. The i f/el se selection structure performs an action if a condition is true or performs 
a different action if the condition is false. The i f/el if/else selection structure performs 
one of many different actions, depending on the truth or falsity of several conditions. 

The if selection structure is a single-selection structure because it selects or ignores a 
single action. The if/else selection structure is a double-selection structure because it 
selects between two different actions. The i f/el if/else selection structure is a multiple- 
selection structure because it selects the action to perform from many different actions. 

Python provides two types of repetition structures; while and for. The if, elif, 
else, while and for structures are Python keywords. These keywords are reserved by 
the language to implement various Python features, such as control structures. Keywords 
cannot be used as identifiers (i.e., variable names). Figure 3.2 lists ali Python keywords. 2 



Common Programming Error 3.1 


Using a keyword as an identifier is a syntax error. 


In ali, Python has only the six control structures: the sequence structure, three types of 
selection structures and two types of repetition structures. Each Python program is formed 
by combining as many control structures as is appropriate for the algorithm the program 
implements. As with the sequence structure shown in Fig. 3.1, we will see that each control 
structure is flowcharted with two small circle symbols, one at the entry point to the control 
structure and one at the exit point. 


Python keywords 


and 

continue 

else 

for 

import 

not 

raise 

assert 

def 

except 

from 

in 

or 

return 

break 

dei 

exec 

global 

is 

pass 

try 

class 

elif 

finally 

if 

lambda 

print 

while 


Fig. 3.2 Python keywords. 


2. Python 2.3 will introduce the keyword yield among others. Visit the Python Web site 
(www. python. org) to view a tentative list of such keywords, and avoid using them as identifi- 
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These single-entry/single-exit control structures make it easy to build programs. The 
control structures are attached to one another by connecting the exit point of one control 
structure to the entry point of the next. This is similar to the way a child stacks building 
blocks; hence, the term control-structure stacking. Control-structure nesting also connects 
control structures; we discuss this technique later in the chapter. 



Any Python program can be constructed from six different types of control structures (se- 
quence, if. if/else, if/elif/else, while and for) combined in two ways (control- 
structure stacking and control-structure nesting). 







3.5 if Selection Structure 


Selection structures choose among alternative courses of action. For example, suppose that 
the passing grade on an examination is 60. Then the pseudocode statement 

If student’s grade is greater than or equal to 60 
Print “Passed” 


determines whether the condition “student’s grade is greater than or equal to 60” is true or 
false. If the condition is true, then “Passed” is printed, and the next pseudocode statement 
in order is “performed.” (Remember that pseudocode is not a real programming language.) 
If the condition is false, the print statement is ignored, and the next pseudocode statement 
is performed. Note that the second line of this selection structure is indented. Such inden- 
tation is optional (for pseudocode), but it is highly recommended because indentation em- 
phasizes the inherent hierarchy of structured programs. When we convert pseudocode into 
Python code, indentation is required. 

The preceding pseudocode if statement may be written in Python as 


if grade >= : 

print "Passed" 

Notice that the Python code corresponds closely to the pseudocode. This similarity is the 
reason that pseudocode is a useful program development tool. The statement in the body of 
the if structure outputs the character string "Passed". 

The flowchart of Fig. 3.3 illustrates the single-selection if structure and the diamond 
symbol. The decision Symbol contains an expression, such as a condition, that can be either 
true or false. The diamond has two flowlines emerging from it: One indicates the direction 
to follow when the expression in the symbol is true; the other indicates the direction to 
follow when the expression is false. We learned, in Chapter 2, Introduction to Python Pro¬ 
gramming, that decisions can be based on conditions containing relational or equality oper- 
ators. Actually, a decision can be based on any expression. For instance, if an expression 
evaluates to zero, it is treated as false, and if an expression evaluates to nonzero, it is treated 
as true. 

Note that the if structure is a single-entry/single-exit structure. We will soon learn 
that the flowcharts for the remaining control structures also contain (besides small circle 
symbols and flowlines) rectangle symbols that indicate the actions to be performed and dia¬ 
mond symbols that indicate decisions to be made. This type of flowchart emphasizes the 
action/decision model of programming. 
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Fig. 3.3 if single-selection structure flowchart. 

We can envision six bins, each containing control structures of one of the six types. These 
control structures are empty—nothing is written in the rectangles or in the diamonds. The pro- 
grammer’s task, then, is assembling a program from as many of each type of control structure 
as the algorithm demands, combining those control structures in only two possible ways 
(stacking or nesting), then filling in the actions and decisions in a manner appropriate for the 
algorithm. We will discuss the variety of ways in which actions and decisions may be written. 


3.6 if/else and if/elif/else Selection Structures 

The i f selection structure performs a specified action only when the condition is true; oth- 
erwise, the action is skipped. The if/else selection structure allows the programmer to 
specify that a different action is to be performed when a condition is true from an action 
when a condition is false. For example, the pseudocode statement 

If student’s grade is greater than or equal to 60 
Print “Passed” 

else 

Print “Failed” 


prints Passed if the student’s grade is greater than or equal to 60 and prints Failed if the 
student’s grade is less than 60. In either case, after printing occurs, the next pseudocode 
statement in sequence is “performed.” Note that the body of the else is indented. The in- 
dented body of a control structure is called a suite. Remember that indentation conventions 
you choose should be applied uniformly throughout programs. It is imperative for Python 
when it is executing code, and programs that do not obey uniform spacing conventions also 
are difficult to read. 



Good Programming Practice 3.1 

Ifthere are several levels of indentation, each suite must be indented. Different suites at the 
same level do not have to be indented by the same amount, but doing so is good programming 
practice. 


The preceding pseudocode if/else structure can be written in Python as 


if grade >= 
print 11 P 
else : 

print "F 
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Common Programming Error 3.2 


Failure to indent ali statements that belong to an i f suite or an else suite results in a syn- 
tax error. 



The flowchart of Fig. 3.4 illustrates the flow of control in the if/else structure. Once 
again, note that (besides small circles and arrows) the symbols in the flowchart are rectan- 
gles (for actions) and diamonds (for decisions). We continue to emphasize this action/deci- 
sion model of computing. Imagine again a bin containing empty double-selection 
structures. The programmer’s job is to assemble these selection structures (by stacking and 
nesting) with other control structures required by the algorithm and to fili in the rectangles 
and diamonds with actions and decisions appropriate to the algorithm being implemented. 

Nested if/else structures test for multiple cases by placing if/else selection 
structures inside other if/else selection structures. For example, the following 
pseudocode statement prints A for exam grades greater than or equal to 90, B for grades 80- 
89, C for grades 70-79, D for grades 60-69 and F for ali other grades. 


If student’s grade is greater than or equal to 90 
Print “A ” 

else 

If student’s grade is greater than or equal to 80 
Print “B” 


else 


If student’s grade is greater than . 


r £>mirtl : 


else 

If student’s grade is greater than or equal to 60 
Print “D” 


else 


Print “F” 









Fig. 3.4 if/else double-selection structure flowchart. 
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This pseudocode can be written in Python as 


if grade >= : 

print "A" 
else : 

if grade >= : 

print "B" 
else : 

if grade >= 
print "C" 
else : 

if grade >= 
print "D 
else : 

print "F 


If grade is greater than or equal to 90, the first four conditions are met, but only the 
print statement after the first test executes. After that print executes, the else part of 
the “outer” if/else statement skips. 



Performance Tip 3.1 

A nested i f/el se structure isfaster than a series of single-selection i f structures because 
the testing of conditions terminates after one ofthe conditions is satisfied. 



Performance Tip 3.2 

'In a nested if/else structure, place the conditions that are more likely to be true at the be- 
ginning ofthe nested if/else structure. This enables the nested if/else structure to run 
f aster and exit earlier than an equivalent if/else structure in which infrequent cases ap- 
pear first. 


Many Python programmers prefer to write the preceding i f structure as 


if grade >= : 

print "A" 
elif grade >= : 

print "B" 
elif grade >= : 

print ”C n 
elif grade >= : 

print ”D n 
else : 

print "F" 

thus replacing the double-selection if/else structure with the multiple-selection i f/elif/ 
else structure. The two forms are equivalent. The latter form is popular because it avoids 
the deep indentation of the code to the right. Such indentation often leaves little room on a 
line, forcing lines to be split over multiple lines and decreasing program readability. 

Each elif can have one or more actions. The flowchart in Fig. 3.5 shows the general 
i f/el i f/el se multiple-selection structure. The flowchart indicates that, after an if or 
elif statement executes, control immediately exits the if/elif/else structure. Again, 
note that (besides small circles and arrows) the flowchart contains rectangle symbols and 
diamond symbols. Imagine that the programmer has access to a deep bin of empty if/ 
el i f/el se structures—as many as the programmer might need to stack and nest with 
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Fig.3.5 if/elif/else multiple-selection structure. 


other control structures to form a structured implementation of an algorithm’s flow of con¬ 
trol. The rectangles and diamonds are then filled with actions and decisions appropriate to 
the algorithm. 

The else statement of the if/elif/else structure is optional. However, most pro- 
grammers include an else statement at the end of a series of elif statements to handle 
any condition that does not match the conditions specified in the elif statements. We call 
the condition handled by the else statement the default condition. If an if/elif struc¬ 
ture specifies an else statement, it must be the last statement in the structure. 



Good Programming Practice 3.2 

Provide a default condition in i f/elif structures. Conditions not explicitly tested in an i f/ 
elif structure witliout a default condition are ignored. Including a default condition focus- 
es the programmer on the need to process exceptional conditions. 



A suite can be placed anywhere in a program that a single statement can be placed. 


The if selection structure can contain several statements in its body (suite), and ali 
these statements must be indented. The following example includes a suite in the else part 
of an if/else structure that contains two statements. A suite that contains more than one 
statement is sometimes called a compound statement. 
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if grade >= : 

print "Passed." 
else : 

print "Failed." 

print "You must take this course again." 

In this case, if grade is less than 60, the program executes both statements in the body of 
the else and prints 

Failed. 

You must take this course again. 

Notice that both statements of the else suite are indented. If the statement 


print "You must take this course again." 

was not indented, the statement executes regardless of whether the grade is less than 60 or 
not. This is an example of a logic error. 

A programmer can introduce two major types of errors into a program: syntax errors 
and logic errors. A syntax emor violates the rules of the programming language. Examples 
of syntax errors include using a key word as an identifier or forgetting the colon (:) after an 
if statement. The interpreter catches a syntax error and displays an error message. 

A logic error causes the program to produce unexpected results and may not be caught 
by the interpreter. A fatal logic error causes a program to fail and terminate prematurely. 
For fatal errors, Python prints an error message called a traceback and exits. A nonfatal 
logic error allows a program to continue executing, but produces incorrect results. 

Common Programming Error 3.3 

Forgetting to indent ali the statements in a suite can lead to syntax or logic errors in a pro¬ 
gram. 

The interactive session in Fig. 3.6 attempts to divide two user-entered values and dem- 
onstrates one syntax emor and two logic errors. The syntax error is contained in the line 



print valuel + 

The + operator needs a right-hand operand, so the interpreter indicates a syntax error. 
The first logic error is contained in the line 


print valuel + value2 

The intention of this line is to print the sum of the two user-entered integer values. How- 
ever, the strings were not converted to integers, thus the statement does not produce the de- 
sired resuit. Instead, the statement produces the concatenation of the two strings—formed 
by linking the two strings together. Notice that the interpreter does not display any messag- 
es because the statement is legal. 

The second logic emor occurs in the line 

print int( valuel ) / int( value2 ) 

The program does not check whether the second user-entered value is 0, so the program 
attempts to divide by zero. Dividing by zero is a fatal logic error. 
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Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 
win32 

Type "help", "Copyright", "credits" or "license" for more Informa¬ 
tion. 

>>> valuel = rawinput( "Enter a number: " ) 

Enter a number: 3 

>>> value2 = rawinput( "Enter a number: " ) 

Enter a number: 0 
>>> print valuel + 

File "<stdin>", line 1 
print valuel + 

A 

SyntaxError: invalid syntax 
>>> print valuel + value2 
30 

>>> print int( valuel ) / int( value2 ) 

Traceback (most recent call last): 

File "<stdin>", line 1, in ? 

ZeroDivisionError: integer division or modulo by zero 

Fig. 3.6 Syntax and logic e mors. 



Common Programming Error 3.4 


An attempt to divide by zero causes afatal logic error. 


Just as multiple statements can be placed anywhere a single statement can be placed, 
it is possible to have no statements at ali, (i.e., empty statements). The empty statement is 
represented by placing keyword pass where a statement normally resides (Fig. 3.7). 


Common Programming Error 3.5 



All control structures must contain at least one statement. A control structure that contains 
no statements causes a syntax error. 


3.7 while Repetition Structure 

A repetition structure allows the programmer to specify that a program should repeat an 
action while some condition remains true. The pseudocode statement 

While there are more items on my shopping list 
Purchase next item and cross it off my list 


Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 
win32 

Type "help", "Copyright", "credits" or "license" for more informa- 
tion. 

>>> if 1 < 2: 

... pass 








Fig. 3.7 Keyword pass. 






































pythonhtpl_03.fm Page 80 Saturday, December 8, 2001 9:34 AM 


80 Control Structures 


Chapter 3 


describes the repetition that occurs during a shopping trip. The condition, “there are more 
items on my shopping list” is either true or false. If it is true, the program performs the ac- 
tion “Purchase next item and cross it off my list.” This action is performed repeatedly while 
the condition remains true. 

The statement(s) contained in the while repetition structure constitute the body (suite) of 
the while. The while structure body can consist of a single statement or multiple statements. 
Eventually, the condition should evaluate to false (in the above example, when the last item 
on the shopping list has been purchased and crossed off the list). At this point, the repetition 
terminates, and the program executes the first statement after the repetition structure. 


Common Programming Error 3.6 



A logic error, called an infinite loop (the repetition structure never terminates), occurs when 
an action that causes the condition in the while structure to become false is missing from 
the body of a while structure. 



Common Programming Error 3.7 


Spelling the keyword while with an uppercase W, as in While( remember that Python is a 
case-sensitive language), is a syntax error. AII of Python ’s reserved keywords, such as 
while. if, elif and else, contain only lowercase letters. 


As an example of a while structure, consider a program segment designed to find the 
first power of 2 larger than 1000. Suppose variable product has been created and initial- 
ized to 2. When the following while repetition structure finishes executing, product will 
contain the desired answer: 


product = 

while product <= : 

product = * product 

At the start of the while structure, product is 2. The variable product is multi- 
plied by 2, successively taking on the values 4, 8, 16, 32,64, 128, 256, 512 and 1024. When 
the value of product equals 1024, the while structure condition, product <= 1000, 
evaluates to false. This terminates the repetition—the final value of product is 1024. Pro¬ 
gram execution continues with the next statement after the while structure. 

The flowchart of Fig. 3.8 illustrates the flow of control in the while structure that cor- 
responds to the preceding while structure. Once again, note that (besides small circles and 
arrows) the flowchart contains a rectangle Symbol and a diamond Symbol. 



Fig. 3.8 while repetition structure flowchart. 
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Imagine a bin of empty while structures that can be stacked and nested with other con¬ 
trol structures to implement an algorithm’s flow of control. The empty rectangles and dia- 
monds are then filled in with appropriate actions and decisions. The flowchart shows the 
repetition. The flowline emerging from the rectangle wraps back to the decision that is tested 
each time through the loop until the decisionbecomes false. Then, the while structure exits 
and control passes to the next statement in the program. 




3.8 Foimulating Algorithms: Case Study 1 
(Counter-Controlled Repetition) 


To illustrate how algorithms are developed, we solve several variations of a class-averaging 
problem. Consider the following problem statement: 

A class often students took a quiz. The grades (integers in the range 0 -100) for this quiz 
are available. Determine the class average on the quiz. 


The class average is equal to the sum of the grades divided by the number of students. The 
algorithm for solving this problem requests each of the grades, performs the averaging cal- 
culation and prints the resuit. 

Using pseudocode, we list the actions to be executed and specify the order in which 
these actions should be executed. We use counter-controlled repetition to input the grades 
one at a time. This technique uses a variable called a comiter to control the number of 
times a set of statements executes. Repetition terminates when the counter exceeds 10. In 
this section, we present a pseudocode algorithm (Fig. 3.9) and the corresponding program 
(Fig. 3.10). In the next section, we show how to develop pseudocode algorithms. Counter- 
controlled repetition often is called definite repetition because the number of repetitions is 
known before the loop begins executing. 

Note the references in the algorithm to the variables total and counter. In the program 
of Fig. 3.10, the variable total (line 5) accumulates the sum of a series of values, while 
the variable counter counts—in this case, it counts the number of user-entered grades. 
Variables that store totals normally are initialized to zero. 


Set total to zero 

Set grade counter to one 

While grade counter is less than or equal to ten 
Input the next grade 
Add the grade into the total 
Add one to the grade counter 

Set the class average to the total divided by ten 
Print the class average 


Fig. 3.9 Pseudocode algorithm that uses counter-controlled repetition to solve 
the class-average problem. 
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1 # Fig. 3.10: fig03_10.py 

2 # Class average program with counter-controlled repetition. 

3 


4 

# initialization phase 



5 

total = 

of 

grades 

6 

7 

gradeCounter = 

of grades entered 

8 

# Processing phase 



9 

while gradeCounter <= : 


# loop 10 times 

10 

grade = raw input( 


* ) # get one grade 

11 

grade = int( grade ) 

# 

convert string to an integer 

12 

total = total + grade 



13 

gradeCounter = gradeCounter + 

14 




15 

# termination phase 



16 

average = total / 


# integer division 

17 

print , 

average 



Fig. 3.10 Counter-controlled repetition used to solve class-average problem. 



Good Programming Practice 3.3 

Initialize counters and totals. 



Lines 5-6 are assignment statements that initialize total to 0 and gradeCounter 
to 1. Line 9 indicates that the while structure should continue as long as grade- 
Counters value is less than or equal to 10. 

Lines 10-11 correspond to the pseudocode statement Input the next grade. Function 
raw_input displays the prompt “Enter grade on the screen and accepts user input. 
Line 11 converts the user-entered string to an integer. 

Next, the program updates total with the new grade entered by the user—line 12 
adds grade to the previous value of total and assigns the resuit to total. 

Then, the program increments the variable gradeCounter to indicate that a grade 
has been processed. Line 13 increments gradeCounter by one, allowing the condition 
in the while structure to evaluate to false and terminate the loop. 

Line 16 executes after the while structure terminates and assigns the results of the 
average calculation to variable average. Line 17 displays the string "Class average 
is", followed by a space (inserted by print), followed by the value of variable 
average. 
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Note that the averaging calculation in the program produces an integer resuit. Actually, 
the sum of the grades in this example is 817, which, when divided by 10, yields 81.7—a 
number with a decimal point. We discuss how to deal with floating-point numbers in the 
next section. 

In Fig. 3.10, if line 16 used gradeCounter rather than 10 for the calculation, the 
output for this program would display an incorrect value, 74, because gradeCounter con- 
tains the values 11, afterthe termination of the while loop. Fig. 3.11 uses an interactive ses- 
sion to demonstrate the value of gradeCounter after the while loop iterates ten times. 


3.9 Foimulating Algorithms withTbp-Down, Stepwise 
Re fi ne me nt Case Sbudy 2 (SentineControlled Repetition) 


Let us generalize the class-average problem. Consider the following problem: 

Develop a class-averaging program that processes an arbitrary number of grades each time 
the program is executed. 


In the first class-average example, the program knows the number of grades (10) to be en- 
tered by the user. In this example, no indication is given of how many grades will be en- 
tered. The program processes an arbitrary number of grades. How can the program 
determine when to stop the input of grades? How will it know when to calculate and print 
the class average? 

One way to solve this problem is to use a special value called a sentinel value (also 
called a signal value, a dummy value or a flag value) to indicate “end of data entry.” The 
user inputs grades until all legitimate grades have been entered. The user then inputs the 
sentinel value to indicate that the last grade has been entered. Sentinel-controlled repetition 
often is called indefinite repetition because the number of repetitions is not known before 
the start of the loop. 

Clearly, the sentinel value must be chosen so that it cannot be confused with an accept- 
able input value. As grades on a quiz normally are nonnegative integers, -1 is an acceptable 
sentinel value for this problem. Thus, executing the class-average program might process 
a stream of inputs such as 95, 96, 75, 74, 89 and -1. The program then computes and prints 
the class average for the grades 95, 96, 75, 74 and 89. 



Common Programming Error 3.8 


Choosing a sentinel value that is a legitimate data value results in a logic error. 


Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 
win32 

Type "help", "Copyright", "credits" or "license" for more Informa¬ 
tion. 

>>> gradeCounter = 1 

>>> while gradeCounter <= 10: 

... gradeCounter = gradeCounter + 1 

>>> print gradeCounter 
11 


Fig. 3.11 Countervalue used after termination of counter-controlled loop. 
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We approach the class-average program with a technique called top-down, stepwise 
refinement , which is essential to the development of well-structured programs. We begin 
with a pseudocode representation of the top: 

Determine the class average for the quiz 

The top is a single statement that conveys the overall function of the program. As such, the 
top is, in effect, a complete representation of a program. Unfortunately, the top (as in this 
case) rarely conveys a sufficient amount of detail from which to write the Python program. 
So we now begin the refinement process. We divide the top into a series of smaller tasks 
and list these in the order in which they need to be performed. This results in the following 
first refinement : 

Initialize variables 

Input, sum and count the quiz grades 

Calculate and print the class average 


In this case, the sequence control structure is used—the steps listed are executed succes¬ 
si vely. 



Each refinement, as well as the top itself is a complete specification ofthe algorithm; only 
the level of detail varies. 



Many programs can be divided logically into three phases: An initialization phase which ini- 
tializes the program variables; a processing phase which inputs data values and adjusts pro¬ 
gram variables accordingly; and a termination phase which calculates and prints the final 
results. 


The preceding Software Engineering Observation often is ali you need for the first 
refinement in the top-down process. To proceed to the next level of refinement (i.e., the 
second refinement ), we commit to specific variables. The program needs to maintain a run- 
ning total of the numbers, a count of how many numbers have been processed, a variable 
that contains the value of each grade and a variable that contains the calculated average. 
The pseudocode statement 

Initialize variables 

can be refined as foliows: 

Initialize total to zero 
Initialize counter to zero 

The pseudocode statement 

Input, sum and count the quiz grades 

requires a repetition structure (i.e., a loop) that successively inputs each grade. We do not 
know how many grades will be entered, so we use sentinel-controlled repetition. The user 
inputs legitimate grades successively. After the last legitimate grade has been entered, the 
user inputs the sentinel value. The program tests for the sentinel value after each grade is 
input and terminates the loop when it has been entered. The second refinement of the pre¬ 
ceding pseudocode statement is 
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Input thefirst grade (possibly the sentinel) 

While the user has not as yet entered the sentinel 
Add this grade into the running total 
Add one to the grade counter 
Input the next grade (possibly the sentinel) 

The pseudocode statement 

Calculate and print the class average 

can be refined as foliows: 


Ifthe counter is not equal to zero 

Set the average to the total divided by the counter 
Print the average 

else 

Print “No grades were entered” 


Notice that we are testing for the possibility of division by zero—a fatal logic error which, 
if undetected, causes the program to fail (often called bombing or crashing). The complete 
second refinement of the pseudocode for the class average problem is shown in Fig. 3.12. 


Good Programming Practice 3.4 


When performing division by an expression whose value could be zero, explicitly testfor this 
case and handle it appropriately in yourprogram (such as by printing an error message) rather 
than allowing the fatal error to occur. In chapter 12, we discuss how to write programs that 
recognize such errors and take appropriate action. This is known as exception handling. 


In Fig. 3.9 and Fig. 3.12, we included some blank lines in the pseudocode to improve 
the readability of the pseudocode. The blank lines separate these statements into their var- 
ious phases. 


Initialize total to zero 
Initialize counter to zero 

Input the first grade (possibly the sentinel) 

While the user has not as yet entered the sentinel 
Add this grade into the running total 
Add one to the grade counter 
Input the next grade (possibly the sentinel) 

Ifthe counter is not equal to zero 

Set the average to the total divided by the counter 
Print the average 

else 

Print “No grades were entered” 


Fig. 3.12 Pseudocode algorithm that usessentinel-controlled repetitionto solve 
the class-average problem. 
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The pseudocode algorithm in Fig. 3.12 solves the more general class-averaging 
problem. This algorithm was developed after two refinements; sometimes more refine- 
ments are necessary. 



The programmer tenninates the top-down, stepwise refinement process when the pseudocode 
algorithm is specified in sufficient detail for the programmer to convert the pseudocode to 
Python. After this step, implementing the Python program normally is straightforward. 


Figure 3.13 shows the Python program and a sample execution. Although each grade 
is an integer, the averaging calculation is likely to produce a number with a decimal point, 
(i.e., a real number). The integer data type cannot represent real numbers. The program 
uses the floating-point data type to handle numbers with decimal points and introduces 
function float, which forces the averaging calculation to produce a floating-point 
numeric resuit. 






1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 
23 


# Fig. 3.13: fig03 13.py 

# Class average program with sentinel-controlled repetition. 


# initialization phase 

total = 

gradeCounter = 


# Processing phase 

grade = raw_input( 
grade = int( grade ) 


) 

# convert string to an integer 


while grade != : 

total = total + grade 
gradeCounter = gradeCounter + 

grade = rawinput( ) 

grade = int( grade ) 


# termination phase 

if gradeCounter != : 

average = float( total ) / gradeCounter 
print , average 

else : 

print "No grades were entered" 



Fig. 3.13 Sentinel-controlled repetition used to solve class-average problem. 



































pythonhtpl_03.fm Page 87 Saturday, December 8, 2001 9:34 AM 


Chapter 3 


Control Structures 87 


In this example, we see that control structures can be stacked on top of one another (in 
sequence) just as a child stacks building blocks. The while structure (lines 12-16) is 
immediately followed by an if/else structure (lines 19-23) in sequence. Much of the 
code in this program is identical to the code in Fig. 3.10, so in this section, we will concen- 
trate on the new features and issues. 

Line 6 initializes the variable gradeCounter to 0, because no grades have been 
entered. To keep an accurate record of the number of grades entered, variable grade¬ 
Counter is incremented only when a grade value is entered. 



Good Programming Practice 3.5 

In a sentinel-controlled loop, the prompts requesting data entry should explicitly remind the 
user ofthe sentinel value. 


Study the difference between the program logic for sentinel-controlled repetition in 
Fig. 3.13 and counter-controlled repetition in Fig. 3.10. In counter-controlled repetition, 
the program reads a value from the user during each pass of the while structure, for a 
specified number of passes. In sentinel-controlled repetition, the program reads one value 
(lines 9-10) before the program reaches the while structure. This value determines 
whether the program’s flow of control should enter the body of the while structure. If the 
while structure condition is false (i.e., the user has already typed the sentinel), the pro¬ 
gram does not execute the while loop (no grades were entered). On the other hand, if the 
condition is true, the program executes the while loop and processes the value entered by 
the user (i.e., adds the grade to total). After processing the grade, the program 
requests the user to enter another grade. After executing the last (indented) line of the 
while loop (line 16), execution continues with the next test of the while structure con¬ 
dition, using the new value just entered by the user to determine whether the while struc¬ 
ture^ body should execute again. Notice that the program requests the next value before 
evaluating the while structure. This allows for determining whether the value just entered 
by the user is the sentinel value before processing the value (i.e., adding it to total). If 
the value entered is the sentinel value, the while structure terminates, and the value is not 
added to total. 

Lines 9-10 and 15-16 contain identical lines of code. In Section 3.15, we introduce 
programming constructs that help the programmer avoid repeating code. 

Averages do not always evaluate to integer values. Often, an average is a value that 
contains a fractional part, such as 7.2 or-93.5. These values are referred to as floating-point 
numbers. 

The calculation total / gradeCounter results in an integer, because total and 
counter contain integer values. Dividing two integers results in integer division, in which 
any fractional part of the calculation is discarded (i.e., truncated). The calculation is per- 
formed first, the fractional part is discarded before assigning the resuit to average. To 
produce a floating-point calculation with integer values, convert one (or both) of the values 
to a floating-point value with function f loat. Recall that functions are pieces of code that 
accomplish a task; in line 20, function f loat converts the integer value of variable sum 
to a floating-point value. The calculation now consists of a floating-point value divided by 
the integer gradeCounter. 

The Python interpreter knows how to evaluate expressions in which the data types of 
the operands are identical. To ensure that the operands are of the same type, the interpreter 
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performs an operation called promotiori (also called implicit conversion ) on selected oper- 
ands. For example, in an expression containing integer and floating-point data, integer 
operands are promoted to floating point. In our example, the value of gradeCounter is 
promoted to a floating-point number. Then, the calculation is performed, and the resuit of 
the floating-point division is assigned to variable average. 


Common Programming Error 3.9 



Assuming that allfloating-point numbers are precise can lead to incorrect results. Mostcom- 
puters approximate floating-point numbers. 


Despite the fact that floating-point numbers are not precise, they have numerous appli- 
cations. For example, when we speak of a “normal” body temperature of 98.6, we do not 
need to be precise to a large number of digits. When we view the temperature on a ther- 
mometer and read it as 98.6, it may actually be 98.5999473210643. The point here is that 
calling this number simply 98.6 is adequate for most applications. 

Another way floating-point numbers develop is through division. When we divide 10 
by 3, the resuit is 3.3333333..., with the sequence of 3s repeating infinitely. The computer 
allocates a fixed amount of space to hold such a value, so the stored floating-point value 
only can be an approximation. 


3.10 Formulating Algorithms with Top-Down, Sbepwise 
Refinement Case Sfcudy 3 (Nested Control Structures) 

Let us work another complete problem. We once again formulate the algorithm using 
pseudocode and top-down, stepwise refinement and we develop a corresponding Python 
program. Consider the following problem statement: 

A college offers a course that prepares students for the state licensing examfor real estate 
brokers. Last year, several of the students who completed this course took the licensing 
examination. Naturally, the college wants to know how well its students did on the exam. You 
have been asked to write a program to summarize the results. You have been given a list of 
these 10 students. Next to each name is written a 1 ifthe student passed the exam and a 2 if 
the student failed. 

Your program should analyze the results ofthe exam asfollows: 

1. lnput each test resuit (i.e., a 1 or a 2). Display the message “Enter resuit” on the 
screen each time the program requests another test resuit. 

2. Count the number oftest results ofeach type. 

3. Display a summary of the test results indicating the number of students who passed 
and the number of students who failed. 

4. Ifmore than 8 students passed the exam, print the message "Raise tuition. ” 

After reading the problem statement carefully, we make the following observations 
about the problem: 

1. The program must process 10 test results. A counter-controlled loop will be used. 

2. Each test resuit is a number—either a 1 or a 2. Each time the program reads a test 
resuit, the program must determine if the number is a 1 or a 2. We test for a 1 in 
our algorithm. If the number is not a 1, we assume that it is a 2. (An exercise at the 
end of the chapter considers the consequences of this assumption.) 
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3. Two counters are used—one to count the number of students who passed the exam 
and one to count the number of students who failed the exam. 

4. After the program has processed ali the results, it must decide if more than eight 
students passed the exam. 

Let us proceed with top-down, stepwise refinement. We begin with a pseudocode rep- 
resentation of the top: 

Analyze exam results and decide iftuition should be raised 

Once again, it is important to emphasize that the top is a complete representation of the pro¬ 
gram, but several refinements are likely to be needed before the pseudocode can evolve nat- 
urally into a Python program. Our first refinement is 


Initialize variables 

Input the ten exam grades and count passes andfailures 

Print a summary ofthe exam results and decide iftuition should be raised 

Here, too, even though we have a complete representation of the entire program, further re¬ 
finement is necessary. We now commit to specific variables. We need counters to record 
the passes and failures, a counter to control the looping process and a variable to store the 
user input. The pseudocode statement 


Initialize variables 


can be refined as foliows: 


(«) 


Initialize passes to zero 
Initialize failures to zero 
Initialize student counter to one 


Notice that only the counters for the number of passes, number of failures and number of 
students are initialized. The pseudocode statement 

Input the ten exam grades and count passes and failures 

requires a loop that successively inputs the resuit of each exam. Here it is known in advance 
that there are precisely ten exam results, so counter-controlled looping is appropriate. In¬ 
side the loop (i.e., nested within the loop), a double-selection structure determines whether 
each exam resuit is a pass or a failure and increments the appropriate counter accordingly. 
The refinement of the preceding pseudocode statement is 

Wliile student counter is less than or equal to ten 
Input the next exam resuit 

If the student passed 
Add one to passes 

else 

Add one to failures 
Add one to student counter 

Notice the use of blank lines to set off the If/else control structure to improve program read- 
ability. The pseudocode statement 

Print a summary ofthe exam results and decide iftuition should be raised 
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may be refined as follows: 

Print the number of passes 
Print the number offailures 

Ifmore than eight students passed 
Print “Raise tuition” 

The complete second refinement appears in Fig. 3.14. Notice that the pseudocode also uses 
blank lines to set off the while structure for program readability. 

This pseudocode is now sufficiently refined for conversion to Python. Figure 3.15 
shows the Python program and two sample executions. 




Initialize passes to zero 
Initialize failures to zero 
Initialize student counter to one 


While student counter is less than or equal to ten 
Input the next exam resuit 

Ifthe student passed 
Add one to passes 

else 

Add one to failures 
Add one to student counter 


Print the number of passes 
Print the number offailures 


Ifmore than eight students passed 
Print “Raise tuition” 


Fig. 3.14 Pseudocode forexamination-resultsproblem. 


1 

# Fig. 3.15: fig03_15.py 




2 

3 

4 

# Analysis of examination 

results. 


# initialize variables 




5 

passes = 

# 

number of passes 


6 

failures = 

# 

number of failures 


7 

8 

9 

studentCounter = 

# 

student counter 


# process 10 students; counter-controlled loop 


10 

while studentCounter <= 

: 



11 

resuit = raw input( 

iter 

resuit (l=pass,2=fail) 

) 

12 

resuit = int ( resuit ) 

# 

one exam resuit 









Fig. 3.15 Examination-resultsproblem. (Part 1 of 2.) 
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13 



14 

if resuit = 

= : 

15 

passes = 

passes + 

16 

else : 


17 

failures 

= failures + 

18 



19 

studentCounter = studentCounter 

20 



21 

# termination 

phase 

22 

print " 

# passes 

23 

print " 

, failures 

24 



25 

if passes > : 


26 

print 'Sais 






Note that line 14 uses the equality operator (==) to test whether the value of variable 
resuit equals 1. Be careful not to confuse the equality operator with the assignment 
Symbol (=). Such confusion can cause syntax or logic errors in Python. 



Common Programming Error 3.10 






Using the = Symbol for equality in a conditional statement is a syntax error. 
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Common Programming Error 3.11 


Using operator ==for assignment is a logic error. 



Experience has shown that the most difficult part ofsolving a problem on a computer is de- 
veloping an algorithmfor the solutiori. Once a correct algorithm has heen specified, the pro- 
cess of producing a working Python program from the algorithm normally is 
straightforward. 








Many experienced programmers write programs without ever using program-development 
tools like pseudocode. These programmers feel that their ultimate goal is to solve the prob¬ 
lem on a computer and that writing pseudocode merely delays the production offinal outputs. 
Although this may workfor simple and familiar problems, it can lead to serious errors and 
delays on large, complex projects. 


3.11 Augmented Assignment Symbols 

Python provides several augmented assignment symbols for abbreviating assignment ex- 
pressions. For example, the statement 

c = c + 3 

can be abbreviated with the augmented addition assignment Symbol += as 

c += 3 

The += Symbol adds the value of the expression on the right of the += sign to the value of 
the variable on the left of the sign and Stores the resuit in the variable on the left of the sign. 
Any statement of the form 

variable = variable operator expression 

where operator is a binary operator, such as or %, can be written in the form 

variable operator= expression 

A statement that uses an augmented assignment Symbol is called an augmented assignment 
statement. Figure 3.16 shows the augmented arithmetic assignment symbols. 


Assignment 

Symbol 

Sample 

expression 

Expia nation 

Assigns 

Assume: c = 3 , 

d = 5, e = 4, f = 

= 2, g = 6, h = 12 


+ = 

c += 7 

c = c + 7 

10 to c 

“ = 

d -= 4 

d = d - 4 

1 to d 


Fig. 3.16 Augmented arithmetic assignment symbols (Partlof2.) 
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Assignment 

Symbol 

Sample 

expressiori 

Expia nation 

Assigns 

* = 

e *= 5 

e = e * 5 

2 0 to e 

* * = 

f **= 3 

f = f ** 3 

8 to f 

/= 

g /= 3 

g = g / 3 

2 to g 

a, 

'o — 

h %= 9 

h = h % 9 

3 to h 


Fig. 3.16 Augmented arithmetic assignment symbo Is. (Part2of2.) 



Portability Tip 3.1 

Augmented assignment symbols were introduced in Python version 2.0. Attempting to use an 
augmented assignment Symbol with an earlier version of Python is a syntax error. 



Common Programming Error 3.12 


Attempting to use an augmented assignment before the variable to the left ofthe assignment 
Symbol has been initialized is an error. 


3.12 EssentialsofCounter-Controlled Repetition 

Counter-controlled repetition requires the following: 

1. the name of a control variable (or loop counter), 

2. the initial value of the control variable, 

3. the amount of increment (or decrement ) by which the control variable is modified 
each time through the loop (also known as each iteration of the loop), and 

4. the condition that tests for the fin a l value of the control variable (i.e., whether 
looping should continue). 


Consider the simple program in Fig. 3.17, which prints the numbers from 0 to 9. Line 
4 names the control variable (counter) and sets it to an initial value of 0. Line 8 in the 
while structure increments the loop counter by 1 for each iteration of the loop. The loop- 
continuation condition in the while structure tests for whether the value of the control 
variable is less than 10. The loop terminates when the control variable is greater than or 
equal to 10 (i.e., counter becomes 10). 


1 # Fig. 3.17: fig03JL7.py 

2 # Counter-controlled repetition. 

3 

4 counter = 

5 

6 while counter < : 

print counter 
counter += 








Fig. 3.17 Counter-controlled repetition. (Parti of 2.) 
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1 

2 

3 

4 

5 

6 

7 

8 
9 


Fig. 3.17 Counter-controlled repetition. (Part2of 2.) 


Common Programming Error 3.13 



Because floating-point values may be approximate, controlling the counting ofloops with 
floating-point variables may resuit in imprecise counter values and inaccurate testsfor ter- 
mination. Programs should control counting loops with integer values. 



Good Programming Practice 3.6 

Put a blank line before and after each control structure to make it stand out in the program. 


Good Programming Practice 3.7 


Too many levels ofnesting can make a program dijficult to understand. As a general rule, try 
to avoid using more than three levels of indentation. 



Good Programming Practice 3.8 

Inserting a blank line above and below each control structure, and indenting the body ofeach 
control structure, give programs a two-dimensional appearance that enhances readability. 


3.13 for Repetition Structure 


The for repetition structure handles all the details of counter-controlled repetition. To illus¬ 
trate the power of for, let us rewrite the program of Fig. 3.17. Figure 3.18 shows the resuit. 

The program operates as follows. When the for structure begins executing, function 
range creates a sequence of values in the range 0-9 (Fig. 3.19). The first value in this 
sequence is assigned to variable counter, and the body of the for structure (line 6) exe- 
cutes. For each subsequent value in the sequence, the value is assigned to variable 
counter, and the body of the for structure executes. This process continues until all 
values in the sequence have been processed. 

Fig. 3.19 shows the sequence returned by function range. This sequence is a Python 
list containing integers in the range 0-9. Note that values in a list are enclosed in square 
brackets (e.g., [ ]) and separated by commas. Lists are covered in detail in Chapter 5, Lists, 
Tuples and Dictionaries. 

Notice that the last value of the sequence returned by function range is one less than 
the argument passed to the function. If the programmer incorrectly wrote 


for counter in range( ): 

print counter 

then the loop executes nine times. This is a common logic error called an off-by-one error. 
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1 # Fig. 3.18: fig03_18.py 

2 # Counter-controlled repetition with the 

3 # for structure and range function. 

4 

5 for counter in range( ): 

6 print counter 


0 

1 

2 

3 

4 

5 

6 

7 

8 
9 

Fig. 3.18 Counter-controlled repetition with the for structure. 


Function range can take one, two or three arguments. If we pass one argument to the 
function (as in Fig. 3.19), that argument, called end, is one greater than the upper bound 
(highest value) of the sequence. In this case, range retums a sequence in the range: 


0- ( end-1 ) 


(«) 


If we pass two arguments, the first argument, called start, is the lower bound — the 
lowest value in the returned sequence—and the second argument is end. In this case, 
range returns a sequence in the range: 


( start )-( end-1 ) 


If we pass three arguments, the first two arguments are start and end, respectively, 
and the third argument, called increment , is the increment value. The sequence pro- 
duced by a call to range with an increment value progresses from start to end in mul- 
tiples of the increment value. If increment is positive, the last value in the sequence is 
the largest multiple less than end. The following three calls to range produce the same 
sequence as in Fig. 3.19. 


range( ) 

range ( , ) 

range ( , , ) 


Python 2.2b2 

(#26, Nov 16 

2001, 11:44:11) [MSC 32 bit (Intel)] on 

win32 



Type "help". 

"Copyright", 

"credits" or "license" for more informa- 

tion. 



>>> range( 10 

) 


[0, 1, 2, 3, 

4, 5, 6, 7, 

8, 9] 








Fig.3.19 Function range. 
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Common Programming Error 3.14 



Forgetting that thefirst value ofthe sequence returned byfunction range, ifno lower bound 
is provided, is zero can lecid to an off-by-one logic error. 


Common Programming Error 3.15 


Forgetting that the last value ofthe sequence returned byfunction range is one less than 
the value ofthe function’s end argument can lead to an off-by-one logic error. 


The increment value of range also can be negative. In this case, it is a decrement and 
the sequence produced progresses downwards from start to end in multiples of the 
increment value. The last value in the sequence is the smallest multiple greater than end 
(Fig. 3.20). 

The sequence used in a for structure does not have to be generated using the range 
function. The general format of the for structure is 


for element in sequence : 
statement(s) 

where sequence is a set of items (sequences are explained in detail in Chapter 5). At the first 
iteration of the loop, variable element is assigned the first item in the sequence and state- 
ment is executed. At each subsequent iteration of the loop, variable elementis assigned the 
next item in the sequence before the execution of statement. Once the loop has been exe¬ 
cuted once for each item in the sequence, the loop terminates. In most cases, the for struc¬ 
ture can be represented by an equivalent while structure, as in 

initialization 


whi 1 e loopContinuationTest : 
statement(s) 
increment 


where the initialization expression initializes the loop’s control variable, loopContinua¬ 
tionTest is the loop-continuation condition and increment increments the control variable. 


Common Programming Error 3.16 



Creating a for structure that contains no body statements is a syntax error. 


If the sequence part of the for structure is empty (i.e., the sequence contains no 
values), the program does not perform the body of the for structure. Instead, execution 
proceeds with the statement following the for structure. 


Python 2.2b2 

(#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 

win32 


Type "help". 

"Copyright", "credits" or "license" for more informa- 

tion. 


>>> range( 10 

O 

1 

I- 1 

l> 

00 

O 

i—1 

6, 5, 4, 3, 2, 1] 






Fig. 3.20 Function range with a third value. 
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Programs frequently display the control variable ( element ) or use it in calculations in 
the loop body. However, this use is not required. It is common to use the control variable 
for controlling repetition while never mentioning it in the body of the for structure. 



Good Programming Practice 3.9 

Avoid changing the value of the control variable in the body of a for loop, because this 
practice can cause subtle logic errors. 


The flowchart of the for structure is similar to that of the while structure. 
Figure 3.21 illustrates the flowchart of the following for statement 


for x in y: 
print x 

The flowchart shows the initialization and the update processes. Note that update occurs 
each time qfter the program performs the body statement. Besides small circles and arrows, 
the flowchart contains only rectangle symbols and a diamond Symbol. The programmer 
filis the rectangles and diamonds with actions and decisions appropriate to the algorithm. 


3.14 llsing the for Repetition Structure 

The following examples show techniques for varying the control variable (loop counter) in 
a for structure. In each case, we write the appropriate for header. Note the change in the 
third argument to range for loops that decrement the control variable. 

a) Vary the control variable from 1 to 100 in increments of 1. 

for counter in range( , ): 

b) Vary the control variable from 100 to 1 in increments of -1 (decrements of 1). 

for counter in range( , , ): 


Esta b lish initiat 
value of control 
variable 


Determine if final 
value of control 
variable hasbeen 
processed 



automatically) 








Fig. 3.21 for repetition structure flowchart. 
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c) Vary the control variable from 7 to 77 in steps of 7. 

for counter in range( , , ): 

d) Vary the control variable from 2 0 to 2 in steps of -2. 

for counter in range( , , ) : 

e) Vary the control variable over the following sequence of values: 2, 5, 8, 11, 14, 

17, 20. 

for counter in range( , , ): 

f) Vary the control variable over the following sequence of values: 99, 88, 77, 66, 

55, 44, 33, 22, 11, 0. 

for counter in range( , , ) : 


The next two examples provide simple applications of the for structure. The program 
in Fig. 3.22 uses the for structure to sum all the even integers from 2 to 10 0. 

The next example computes compound interest using the for structure. Consider the 
following problem statement: 


A person invests $1000 in a savings account yielding 5 percent interest. Assuming that all 
interest is left on deposit in the account, calculate and print the amount of money in the 
account at the end of each year for 10 years. Use the following formula for determining 
these amounts: 


a=p{\+r) n 

where 

p is the original amount invested (i.e., the principal), 
r is the annual interest rate, 
n is the number of years and 

a is the amount on deposit at the end of the nth year. 


This problem involves a loop that performs the indicated calculation for each of the 10 
years the money remains on deposit. Figure 3.23 shows the solution. The for structure 
executes the body of the loop 10 times, incrementing a control variable (year) from 1 to 
10. In this example, the algebraic expression (1 + r)" is written as ( 1 + rate ) ** year, 
where variable rate represents r and variable year represents n. 


1 

# Fig. 3.22: fig03 22.py 


2 

# Summation with for. 


3 



4 

sum = 


5 



6 

for number in range( , 

, ) : 

7 

sum += number 


8 



9 

print , sum 


Sum 

is 2550 









Fig. 3.22 Summatiori with for. 
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1 # Fig. 3.23: fig03_23.py 

2 # Calculating compound interest. 

3 

4 principal = 

5 rate = 

6 

7 print % 

8 

9 for year in range ( , ) : 

10 amount = principal * ( + rate ) ** year 

11 print % ( year, amount ) 


Year 

1 

2 

3 

4 

5 

6 

7 

8 
9 

10 


Amount on deposit 
1050.00 

1102.50 
1157.63 

1215.51 
1276.28 

1340.10 

1407.10 
1477.46 
1551.33 
1628.89 


Fig. 3.23 for structure used to calculate compound interest. 


(«) 


The output statement before the for loop (line 7) and the output statement in the for 
loop (line 11) combine to print the values of the variables year and amount with the for- 
matting specified by the % formatting operator specifications. The characters %4d specify 
that the year column is printed with a fteld width of four (i.e., the value is printed with at 
least four character positions). If the value to be output is fewer than four character posi- 
tions wide, the value is right justified in the field by default. If the value to be output is more 
than four character positions wide, the field width is extended to accommodate the entire 
value. 

The characters %21.2 f indicate that variable amount is printed as a float-point value 
(specified with the character f) with a decimal point. The column has a total field width of 
21 character positions and two digits of precision to the right of the decimal point; the total 
field width includes the decimal point and the two digits to its right, hence 18 of the 21 posi¬ 
tions appear to the left of the decimal point. 

Notice that the variables amount, principal and rate are floating point values. 
We did this for simplicity, because we are dealing with fractional parts of dollars and thus 
need a type that allows decimal points in its values. Unfortunately, this can cause trouble. 
Here is an example of what can go wrong when using floating point values to represent 
dollar amounts (assuming that dollar amounts are displayed with two digits to the right of 
the decimal point); Two dollar amounts stored in the machine could be 14.234 (which 
would normally be rounded to 14.23 for display purposes) and 18.673 (which would nor- 
mally be rounded to 18.67 for display purposes). When these amounts are added, they pro¬ 
duce the internal sum 32.907, which would normally be rounded to 32.91 for display 
purposes. Thus, your printout could appear as 
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14.23 
+ 18.67 


32.91 


but a person adding the individual numbers as printed would expect the sum to be 32.90. 
You ha ve been warned! 



Good Programming Practice 3.10 

Be careful when using floating-point values to perform monetary calculations. Roimding er- 
rors may lead to undesired results. 


Note that the body of the for structure contains the calculation 1.0 + rate (line 10). 
In fact, this calculation produces the same resuit each time through the loop, so repeating 
the calculation is wasteful. A better solution would be to define a variable (e.g., f inal- 
Rate that references the value of 1.0 + rate before the start of the for structure. Then, 
replace the calculation 1.0 + rate (line 10) with variable f inalRate. 



Performance Tip 3.3 

Avoid placing expressioris whose values do not change inside loops. 







3.15 break and continue Statements 

Python offers the break and continue statements, which alter the flow of control. The 
break statement, when executed in a while or for structure, causes immediate exit 
from that structure. Program execution continues with the first statement after the structure. 
Figure 3.24 demonstrates the break statement in a for repetition structure. When the if 
structure detects that x equals 5, it executes the break statement. This terminates the for 
statement and the program continues with the print statement (line 11). The loop outputs 
four numbers. 

Figure 3.25 is a modified version of Fig. 3.13, the class-average program illustrating 
sentinel-controlled repetition. This version eliminates the repeated code found in the orig- 
inal program. Line 9 introduces an infinite while loop. The condition of the while loop 
never evaluates to false because 1 is always true. Lines 10-11 prompt the user for a grade 
and convert the input to an integer. If the grade is the sentinel value, -1, the program exits 
the loop (line 16). 


1 

# Fig. 3.24: fig03 

24. py 

2 

# Using the break ; 

statement in a for structure. 

3 



4 

for x in range ( , 

) : 

5 



6 

if x == : 


7 

break 


8 



9 

print x. 


10 



11 

print 11 

, X 


Fig. 3.24 break statement used in a for structure. (Part 1 of 2.) 
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12 3 4 

Broke out of loop at x = 5 


Fig.3.24 break statement used in a for structure. (Part 2 of 2.) 







1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 


# Fig. 3.25: fig03_25.py 

# Using the break statement to avoid repeating code 

# in the class-average program. 

# initialization phase 

total = 

gradeCounter = 

while : 

grade = raw_input( ) 

grade = int( grade ) 

# exit loop if user inputs -1 

if grade == : 

break 


total += grade 
gradeCounter += 

# termination phase 

if gradeCounter != : 

average = float ( total ) 

print "Class average is" 

else : 

print "No grades were en 


/ gradeCounter 
average 


Enter 

grade. 

-1 

to 

end: 

75 

Enter 

grade. 

-1 

to 

end: 

94 

Enter 

grade. 

-1 

to 

end: 

97 

Enter 

grade. 

-1 

to 

end: 

88 

Enter 

grade. 

-1 

to 

end: 

70 

Enter 

grade. 

-1 

to 

end: 

64 

Enter 

grade. 

-1 

to 

end: 

83 

Enter 

grade. 

-1 

to 

end: 

89 

Enter 

grade. 

-1 

to 

end: 

-1 

Class 

average 

is 

! 82 

1.5 



Fig. 3.25 break statement used to eliminate code repetition. 


The continue statement, when executed in a while or a for structure, skips the 
remaining statements in the body of that structure and proceeds with the next iteration of 
the loop. In while structures, the loop-continuation test is evaluated immediately after the 
execution of the continue statement. In the for structure, the control variable is 
assigned the next value in the sequence (if the sequence contains more values). Earlier, we 
stated that the while structure usually can represent the for structure. The one exception 
occurs when the increment expression in the while structure follows the continue 
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statement. In this case, the increment is not executed before the repetition-continuation 
condition is tested, and the while does not execute in the same manner as the for. 
Figure 3.26 uses the continue statement in a for structure to skip the output statement 
in the structure and begin the next iteration of the loop. 



Good Programming Practice 3.11 

Some programmers feel that break and continue violate structuredprogramming. Be- 
cause the ejfects ofthese statements can be achieved by structured programming techniques 
we discuss, these programmers do not use break and continue. 


3.16 Logic a I Operatois 

So far, we have studied simple conditions , such as counter <= 10, total > 1000 and 
number ! = sentinelValue. We have expressed these conditions in terms of the rela- 
tional operators >,<,>= and <= and the equality operators == and ! =. Each decision tested 
precisely one condition. To test multiple conditions while making a decision, we performed 
these tests in separate statements or in nested if or if/else structures. 

Python provides logical operators that are used to form more complex conditions by 
combining simple conditions. The logical operators are and (logical AND), or (logical 
OR) and not (logical NOT , also called logical negation). We now consider examples of 
each of these operators. 

Suppose we wish to ensure that two conditions are both true before we choose a certain 
path of execution. In this case, we can use the logical and operator as follows: 

if gender == and age >= : 

seniorFemales += 

This if statement contains two simple conditions. The condition gender == "Female" 
is evaluated here to determine whether a person is a female. The condition age >= 65 is 
evaluated to determine whether a person is a senior Citizen. The simple condition to the left 
of the and operator is evaluated first, because the precedence of == is higher than the pre- 
cedence of and. If necessary, the simple condition to the right of the and operator is eval¬ 
uated next, because the precedence of >= is higher than the precedence of and (as we will 
discuss shortly, the right side of a logical AND expression is evaluated only if the left side 
is true). The if statement then considers the combined condition: 


1 # Fig. 3.26: fig03_26.py 

2 # Using the continue statement in a for/in structure. 

3 

4 for x in range ( , ) : 

5 

6 if x == : 

7 continue 

8 

9 print x, 

10 

11 print "\nUsed continue to skip printing the value 5" 


Fig. 3.26 continue statement used in a f or structure. (Part 1 of 2.) 
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12346789 10 

Used continue to skip printing the value 5 


Fig.3.26 continue statement used in a f or structure. (Part 2 of 2.) 

gender == and age >= 

This condition is true only if both of the simple conditions are true. Finally, if this combined 
condition is indeed true, then the count of seniorFemales is incremented by 1. If either 
or both of the simple conditions are false, then the program skips the incrementing and pro- 
ceeds to the statement following the if. The preceding combined condition can be made 
more readable by adding redundant parentheses 

( gender == ) and ( age >= ) 

The table of Fig. 3.27 summarizes the and operator. The table shows all four possible 
combinations of false and true values for expressioni and expression2. Such 
tables are often called truth tables. 

Python evaluates to false or true all expressions that include relational operators and 
equality operators. A simple condition (e.g., age >= 65 ) that is false evaluates to the 
integer value 0; a simple condition that is true evaluates to the integer value 1. A Python 
expression that evaluates to the value 0 is false; a Python expression that evaluates to a non- 
zero integer value is true. The interactive session of Fig. 3.28 demonstrates these concepts. 

Lines 5-10 of the interactive session demonstrate that the value 0 is false. Lines 11-18 
show that any non-zero integer value is true. The simple condition in line 19 evaluates to 
true (line 20). The combined conditions in lines 21 and 23 demonstrate the return values of 
the and operator. If a combined condition evaluates to false (line 21), the and operator 
returns the first value which evaluated to false (line 22). Conversely, if the combined con¬ 
dition evaluates to true (line 23), the and operator returns the last value in the condition 
(line 24). 

Now let us consider the or (logical OR) operator. Suppose we wish to ensure at some 
point in a program that either one or both of two conditions are true before we choose a 
certain path of execution. In this case, we use the or operator, as in the following program 
segment: 

if semesterAverage >= or finalExam >= : 

print "Student grade is A" 


expressioni 

expiession2 

expressioni and expression2 

false 

false 

false 

false 

true 

false 

true 

false 

false 

true 

true 

true 


Fig. 3.27 Trnth table forthe and (logical AND) operator. 
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This preceding condition also contains two simple conditions. The simple condition 
semesterAverage >= 9 0 is evaluated to determine whether the student deserves an 
“A” in the course because of a solid performance throughout the semester. The simple con¬ 
dition finalExam >= 90 is evaluated to determine whether the student deserves an “A” 
in the course because of an outstanding performance on the final exam. The i f statement 
then considers the combined condition 


semesterAverage >= or finalExam >= 

and awards the student an “A” if either one or both of the simple conditions are true. Note 
that the message S tuden t grade i s A is not printed when both of the simple conditions 
are false. Fig. 3.29 is a truth table for the logical OR operator (or). 


expressioni 

expression2 

expressioni or expression2 

false 

false 

false 

false 

true 

true 

true 

false 

true 

true 

true 

true 








Fig. 3.29 Truth table forthe or (logical OR) operator. 
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If a combined condition evaluates to true, the or operator returns the first value which 
evaluated to true. Conversely, if the combined condition evaluates to false, the or operator 
returns the last value in the condition. 

The and operator has a higher precedence than the or operator. Both operators asso¬ 
ciate from left to right. An expression containing and or or operators is evaluated until its 
truth or falsity is known. This is called short circuit evaluation. Thus, evaluation of the 
expression 

gender == and age >= 

will stop immediately if gender is not equal to "Female" (i.e., the entire expression is 
false), but continue if gender is equal to " Female " (i.e., the entire expression could stili 
be true, if the condition age >= 65 is true). 

Performance Tip 3.4 

In expressioris using operator and, ifthe separate conditions are independent ofone anoth- 
er, rnake the condition that is more likely to be false the left-most condition. In expressioris 
using operator or, rnake the condition that is more likely to be true the left-most condition. 
This approach can reduce a progranTs execution time. 

Python provides the not (logical negation) operator to enable a programmer to 
“reverse” the meaning of a condition. Unlike the and and or operators, which combine 
two conditions (binary operators), the logical negation operator has a single condition as an 
operand (i.e., not is a unary operator). The logical negation operator is placed before a 
condition when we are interested in choosing a path of execution if the original condition 
(without the logical negation operator) is false, such as in the following program segment: 

if not grade == sentinelValue: 

print , grade 

Figure 3.30 is a truth table for the logical negation operator. In many cases, the programmer 
can avoid using logical negation by expressing the condition differently with an appropriate 
relational or equality operator. For example, the preceding statement can also be written as 
follows: 

if grade != sentinelValue: 

print , grade 

This flexibility can often help a programmer express a condition in a more “natural” or con¬ 
venient manner. 



expression 

not expression 

false 

true 

true 

false 


Fig. 3.30 Truth table foroperatornot (logical negation). 
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Figure 3.31 shows the precedence and associativity of the Python operators introduced 
to this point. The operators are shown from top to bottom, in decreasing order of prece¬ 
dence. 




3.17 Sbitctured-Programming Summa ry 

Just as architects design buildings by employing the collective wisdom of their profession, 
so should programmers design their programs. The field of computer programming is 
younger than architecture, and our collective wisdom is considerably sparser. We have 
learned that structured programming produces programs that are easier than unstructured 
programs to understand and hence are easier to test, debug, modify, and even prove correct 
in a mathematical sense. 

Figure 3.32 summarizes Python’s control structures. Small circles are used in the 
figure to indicate the single entry point and the single exit point of each structure. Con- 
necting individual flowchart symbols arbitrarily can lead to unstructured programs. There- 
fore, the programming profession has chosen to combine flowchart symbols to form a 
limited set of control structures and to build structured programs by properly combining 
control structures in only two simple ways. 

For simplicity, single-entry/single-exit control structures are used—there is one way 
to enter and one way to exit each control structure. Connecting control structures in 
sequence to form structured programs is simple—the exit point of one control structure is 
connected to the entry point of the next control structure, so that control structures are 
simply placed one after another in a program; we have called this “control-structure 
stacking.” The rules for forming structured programs also allow for control structures to be 
nested. 

Figure 3.33 shows the rules for forming properly structured programs. The rules 
assume that the rectangle flowchart Symbol may be used to indicate any action, including 
input and output. The rules also assume that we begin with the simplest flowchart 
(Fig. 3.34). 


Operators 

Associativity 

Type 

() 

left to right 

parentheses 

* * 

right to left 

exponentiation 

* / % 

left to right 

multiplicative 

+ 

left to right 

additive 

II 

A 

A 

II 

V 

V 

left to right 

relational 

== != <> 

left to right 

equality 

and 

left to right 

logical AND 

or 

left to right 

logical OR 

not 

right to left 

logical NOT 


Fig. 3.31 Operatorprecedence and associativity. 
































Fig. 3.32 Single-entry/single-exitsequence, selection and repetition structures. 

Rules for Forming Strue tuied Programs 

1) Begin with the so called simplest flowchart (Fig. 3.34). 

2) Any rectangle (action) can be replaced by two rectangles (actions) in sequence. 








Fig. 3.33 Rulesforforming stmctured programs. (Partlof2.) 
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Rules for Forming Structured Programs 

3) Any rectangle (action) can be replaced by any control structure (sequence, if, if/else, 
if/elif/else, while or for). 

4) Rules 2 and 3 can be applied as often as you like and in any order. 

Fig. 3.33 Rulesforforming structured programs. (Part2of 2.) 


i 

( ) 


Fig. 3.34 Simplestflowchart. 




Applying the rules of Fig. 3.33 always results in a structured flowchart with a neat, 
building-block appearance. For example, repeatedly applying rule 2 to the simplest flowchart 
results in a structured flowchart containing many rectangles in sequence (Fig. 3.35). Notice 
that rule 2 generates a stack of control structures, so let us call rule 2 the stacking rule. 

Rule 3 is called the nesting rule. Repeatedly applying rule 3 to the simplest flowchart 
results in a flowchart with neatly nested control structures. For example, in Fig. 3.36, the 
rectangle in the simplest flowchart is first replaced with a double-selection (if/else) 
structure. Then rule 3 is applied again to both of the rectangles in the double-selection struc¬ 
ture, replacing each of these rectangles with double-selection structures. The dashed boxes 
around each of the double-selection structures represent the rectangles that were replaced. 










Fig. 3.35 Applying (repeatedly) rule 2 of Fig. 3.33 to the simplestflowchart. 
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Fig. 3.36 Applying mle 3 of Fig. 3.35tothe simplestflowchart. 

Rule 4 generates larger, more involved and more deeply nested structures. The flow- 
charts that emerge from applying the rules in Fig. 3.33 constitute the set of all possible 
structured flowcharts and hence the set of all possible structured programs. 

The beauty of the structured approach is that we use only six simple single-entry/ 
single-exit pieces, and we assemble them in only two simple ways. Figure 3.37 shows the 
kinds of stacked building blocks that emerge from applying rule 2 and the kinds of nested 
building blocks that emerge from applying rule 3. The figure also shows the kind of over- 
lapped building blocks that cannot appear in structured flowcharts (because of the elimina- 
tion of the goto statement). 

If the rules in Fig. 3.33 are followed, an unstructured flowchart (such as that in 
Fig. 3.38) cannot be created. If you are uncertain of whether a particular flowchart is struc¬ 
tured, apply the rules of Fig. 3.33 in reverse to try to reduce the flowchart to the simplest 
flowchart. If the flowchart is reducible to the simplest flowchart, the original flowchart is 
structured; otherwise, it is not. 
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Nested building blocks 


Nested building blocks 


Overlapping building blocks 
(lllegal in structured programs) 


Fig. 3.37 Stacked, nested and overiapped building blocks 







Fig. 3.38 Unstmctured flowchart. 

Structured programming promotes simplicity. Bohm and Jacopini have given us the 
resuit that only three forms of control are needed: 

• Sequence 

• Selection 

• Repetition 

Sequence is trivial. Selection is implemented in one of three ways: 

• if structure (single selection) 

• if/else structure (double selection) 

• if/elif/else structure (multiple selection) 

In fact, it is straightforward to prove that the simple i f structure is sufficient to provide any 
form of selection—everything that can be done with the if/else structure and the if/ 
elif/else structure can be implemented by combining if structures (although perhaps 
not as clearly and efficiently). 

Repetition is implemented in one of two ways: 

• while structure 

• for structure 
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It is straightforward to prove that the while structure is sufficient to provide any form of 
repetition. Everything that can be done with the for structure can be done with the while 
structure (although perhaps not as smoothly). 

Combining these results illustrates that any form of control ever needed in a Python 
program can be expressed in terms of the following: 

• sequence 

• i f structure (selection) 

• while structure (repetition) 

Also, these control structures can be combined in only two ways—stacking and nesting. In- 
deed, structured programming promotes simplicity. 

In this chapter, we discussed how to compose programs from control structures con- 
taining actions and decisions. In Chapter 4, Functions, we introduce another program- 
structuring unit, called the f unet ion. We learn to compose large programs by combining 
functions that, in turn, are composed of control structures. We also discuss how functions 
promote Software reusability. In Chapter 7, Object-Oriented Programming, we introduce 
Python’s other program-structuring unit, called the class. We then create objects from 
classes and proceed with our treatment of object-orientedprogramming (OOP). 

SUMMARY 

• Any computing problem can be solved by exeeuting a series of actions in a specified order. An 
algorithm solves problems in terms of the actions to be exeeuted and the order in which these ac¬ 
tions are exeeuted. 

• Specifying the order in which statements exeeute in a computer program is called program control. 

• Pseudocode is an artificial and informal language that helps programmers develop algorithms. 
Pseudocode is similar to everyday English; it is convenient and user-friendly, although it is not an 
actual computer programming language. 

• A carefully prepared pseudocode program can be converted easily to a corresponding Python pro¬ 
gram. In rnany cases, this is done simply by replacing pseudocode statements with their Python 
equivalents. 

• Normally, statements in a program exeeute successively in the order in which they appear. This is 
called sequential exeeution. Various Python statements enable the programmer to specify that the 
next statement to be exeeuted may be other than the next one in sequence. This is called transfer 
of control. 

• The goto statement allows a programmer to specify a transfer of control to one of a wide range 
of possible destinations in a program. 

• The research of Bohm and Jacopini demonstrated that programs could be written without any 
goto statements. The challenge of the erabecame for programmers to shift their styles to “goto- 
less programming.” 

• Bohm and Jacopini demonstrated that all programs could be written in terms of only three control 
structures—the sequence, selection and repetition structures. 

• The sequence structure is built into Python. Unless directed otherwise, the computer exeeutes Py¬ 
thon statements sequentially. 

• A flowchart is a graphical representation of an algorithm or of a portion of an algorithm. Flow- 
charts are drawn using certain special-purpose symbols, such as rectangles, diamonds, ovals and 
small circles; these symbols are connected by arrows called flowlines. 
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• Like pseudocode, flowcharts aid in the development and representation of algorithms. Although 
most programmers prefer pseudocode, flowcharts nicely illustrate how control structures operate. 

• The rectangle symbol, also called the action Symbol, indicates an action, including a calculation or 
an input/output operation. Python allows for as many actions as necessary in a sequence structure. 

• Perhaps the most important flowchart symbol is the diamond symbol, also called the decision Sym¬ 
bol, which indicates a decision is to be performed. 

• Python provides three types of selection structures: if, if/else and if/elif/else. 

• The if selection structure either performs (selects) an action if a condition (predicate) is true or 
skips the action if the condition is false. 

• The if/else selection structure performs an action if a condition is true or performs a different 
action if the condition is false. 

• The i f/el i f /el se selection structure performs one of many different actions, depending on the 
validity of several conditions. 

• The if selection structure is a single-selection structure—it selects or ignores a single action. The 
if/else selection structure is a double-selection structure—it selects between two different ac¬ 
tions. The if/elif/else selection structure is a multiple-selection structure—it selects from 
many possible actions. 

• Python provides two types of repetition structures: while and for. 

• The words if, elif, eis e, while and for are Python keywords. These keywords are reserved 
by the language to implement various Python features, such as control structures. Keywords can- 
not be used as identifiers (e.g., variable names). 

• Python has six control structures: sequence, three types of selection and two types of repetition. 
Each Python program is formed by combining as many control structures of each type as is appro- 
priate for the algorithm the program implements. 

• Single-entry/single-exit control structures make it easy to build programs—the control structures 
are attached to one another by connecting the exit point of one control structure to the entry point 
of the next. This is similar to the way a child stacks building blocks; hence, the term control-struc- 
ture stacking. 

• Indentation emphasizes the inherent structure of structured programs and, unlike in most other 
programming languages, is actually required in Python. 

• Nested if/else structures test for multiple cases by placing if/else selection structures inside 
other if/else selection structures. 

• Nested if/else structures and the multiple-selection if/elif/else structure are equivalent. 
The latter form is popular because it avoids deep indentation of the code. Such indentation often 
leaves little room on a line, forcing lines to be split over multiple lines and decreasing program 
readability. 

• The else block of the if/elif/else structure is optional. However, most programmers in¬ 
clude an else block at the end of a series of elif blocks to handle any condition that does not 
match the conditions specified in the elif statements. If an if/elif statement specifies an 
else block, the else block must be the last block in the statement. 

• The i f selection structure can contain several statements in the body of an i f statement, and all 
these statements must be indented. A set of statements contained within an indented code block is 
called a suite. 

• A fatal logic error causes a program to fail and terminate prematurely. For fatal errors, Python 
prints an error message called a traceback and exits. A nonfatal logic error allows a program to 
continue executing, but might produce incorrect results. 
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• Just as multiple statements can be placed anywhere a single statement can be placed, it is possible 
to have no statements at all, (i.e., empty statements). The empty statement is represented by plac- 
ing keyword pass where a statement normally resides. 

• A repetition structure allows the programmer to specify that a program should repeat an action 
while some condition remains true. 

• Counter-controlled repetition uses a variable called a counter to control the number of times a set 
of statements executes. Counter-controlled repetition often is called definite repetition because the 
number of repetitions must be known before the loop begins executing. 

• A sentinel value (also called a signal value, a dummy value or a flag value) indicates “end of data 
entry.” Sentinel-controlled repetition often is called indefinite repetition because the number of 
repetitions is not known before the start of the loop. 

• In top-down, stepwise refinement, which is essential to the development of well-structured pro- 
grams, the top is a single statement that conveys the overall function of the program. As such, the 
top is, in effect, a complete representation of a program. Thus, it is necessary to divide (refine) the 
top into a series of smaller tasks and list these in the order in which they need to be performed. 

• Floating-point numbers contain a decimal point, as in 7.2 or -93.5. 

• Dividing two integers results in integer division, in which any fractional part of the calculation is 
discarded (i.e., truncated). 

• To produce a floating-point calculation with integer values, convert one (or both) of the values to 
a floating-point value with function f loat. 

• The Python interpreter evaluates expressions in which the data types of the operands are identical. 
To ensure that the operands are of the same type, the interpreter performs an operation called pro- 
motion (also called implicit conversion) on selected operands. 

• Python provides several augmented assignment symbols for abbreviating assignment expressions 
run together. 

• Any statement of the form variable = variable operator expression where operator is a binary 

operator, such as and %, can be written in the form variable operatoi— expression. 

• Function range can take one, two or three arguments. If we pass one argument to the function, 
that argument, called end, is one greater than the upper bound (highest value) of the sequence. 

• If we pass two arguments, the first argument, called start, is the lower bound—the lowest value 
in the returned sequence — and the second argument is end. 

• If we pass three arguments, the first two arguments are start and end, respectively, and the third 
argument, called increment, is the increment value. The sequence produced by a call to range 
with an increment value progresses from start to end in multiples of the increment value. If 
increment is positive, the last value in the sequence is the largest multiple less than end. 

• The increment value of range also can be negative. In this case, it is a decrement and the se¬ 
quence produced progresses downwards from start to end in multiples of the increment value. 
The last value in the sequence is the smallest multiple greater than end. 

• The break statement, when executed in a while or for structure, causes immediate exit from 
that structure. Program execution continues with the first statement after the structure. 

• The continue statement, when executed in a while or a for structure, skips the remaining 
statements in the body of that structure and proceeds with the next iteration of the loop. 

• Python provides logical operators that form more complex conditions by combining simple con- 
ditions. The logical operators are and (logical AND), or (logical OR) and not (logical NOT, also 
called logical negation). 
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• Python evaluates to false or true ali expressions that include relational operators and equality op- 
erators. A simple condition (e.g., age >= 65 ) that is false evaluates to the integer value 0; a 
simple condition that is true evaluates to the integer value 1. A Python expression that evaluates 
to the value 0 is false; a Python expression that evaluates to a non-zero integer value is true. 

• If a combined condition evaluates to false, the and operator returns the first value which evaluated 
to false. Conversely, if the combined condition evaluates to true, the and operator returns the last 
value in the condition. 

• If a combined condition evaluates to true, the or operator returns the first value which evaluated 
to true. Conversely, if the combined condition evaluates to false, the or operator returns the last 
value in the condition. 

• The and operator has a higher precedence than the or operator. Both operators associate from left 
to right. An expression containing and or or operators is evaluated until its truth or falsity is 
known. This is called short Circuit evaluation. 

• The not (logical negation) operator enables a programmer to “reverse” the meaning of a condi¬ 
tion. Unlike the and and or operators, which combine two conditions (binary operators), the log¬ 
ical negation operator has a single condition as an operand (i.e., not is a unary operator). 


TERMINOLOGY 

action/decision model of programming 

action symbol 
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program control 
promotion 
pseudocode 
range function 
rectangle Symbol 
repetition structure 
second refinement 
selection structure 
sentinel value 
sequence 

sequence structure 
sequential execution 
short-circuit evaluation 
signal value 
simple condition 

single-entry/single-exit control structure 


single-selection structure 
small circle symbol 
stacking rule 

start argument of range function 

structured programming 

suite 

termination phase 

top-down, stepwise refinement 

total 

traceback 
transfer of control 
truth table 
unary operator 
upper bound 

while repetition structure 


SELF-REVIEW EXERCISES 

3.1 Fili in the blanks in each of the following statements: 

a) The if/elif/else structure is a_structure. 

b) The words if and else are examples of reserved words called Python_. 

c) Sentinel-controlled repetition is called_because the number of repetitions is 

not known before the loop begins executing. 

d) The augmented assignment symbol *= performs_. 

e) Function_creates a sequence of integers. 

f) A procedure for solving a problem is called a(n)_. 

g) The keyword_represents an empty statement. 

h) A set of statements within an indented code block in Python is called a_. 

i) All programs can be written in ternis of three control structures, namely,_, 

_and_. 

j) A_is a graphical representation of an algorithm. 

3.2 State whether each of the following is true or false. If false, explain why. 

a) Pseudocode is a simple programming language. 

b) The if selection structure performs an indicated action when the condition is true. 

c) The i f/else selection structure is a single-selection structure. 

d) A fatal logic error causes a program to execute and produce incorrect results. 

e) A repetition structure performs the statements in its body while sorne condition remains 
true. 

f) Function f loat converts its argument to a floating-point value. 

g) The exponentiation operator * * associates left to right. 

h) Function call range (1,10) returns the sequence 1 to 10, inclusive. 

i) Sentinel-controlled repetition uses a counter variable to control the number of times a set 
of instructions executes. 

j) The symbol = tests for equality. 


ANSWERS TO SELF-REVIEW EXERCISES 

3.1 a) multiple-selection. b) keywords. c) indefinite repetition. d) multiplication. e) range. 
f) algorithm. g) pass. h) suite, i) the sequence structure, the selection structure, the repetition struc¬ 
ture. j) flowchart. 
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3.2 a) False. Pseudocode is an artificial and informal language that helps programmers develop 
algorithms. b) True. c) False. The if/else selection structure is a double-selection structure—it se- 
lects between two different actions. d) False. A fatal logic error causes a program to terminate, 
e) True. f) True. g) False. The exponentiation operator associates from right to left. h) False. Function 
call range ( 1, 10) returns the sequence 1-9, inclusive. i) False. Counter-controlled repetition uses 
a counter variable to control the number of repetitions; sentinel-control repetition waits for a sentinel 
value to stop repetition. j) False. The operator = = tests for equality; the Symbol = is for assignment. 

EXERCISES 

3.3 Drivers are concerned with the mileage obtained by their automobiles. One driver has kept 
track of several tankfuls of gasoline by recording miles driven and gallons used for each tankful. De¬ 
velop a Python program that prompts the user to input the miles driven and gallons used for each tank¬ 
ful. The program should calculate and display the miles per gallon obtained for each tankful. After 
Processing all input information, the program should calculate and print the combined miles per gal¬ 
lon obtained for all tankful (= total miles driven divide by total gallons used). 






Enter the gallons used (-1 to end): 12.8 
Enter the miles driven: 287 

The miles / gallon for this tank was 22.421875 
Enter the gallons used (-1 to end): 10.3 
Enter the miles driven: 200 

The miles / gallon for this tank was 19.417475 
Enter the gallons used (-1 to end): 5 
Enter the miles driven: 120 

The miles / gallon for this tank was 24.000000 

Enter the gallons used (-1 to end): -1 

The overall average miles/gallon was 21.601423 


3.4 A palindrome is a number or a text phrase that reads the same backwards or forwards. For 
example, each of the following five-digit integers is a palindrome: 12321, 55555, 45554 and 11611. 
Write a program that reads in a five-digit integer and determines whether it is a palindrome. (Hint: 
Use the division and modulus operators to separate the number into its individual digits.) 

3.5 Input an integer containing Os and ls (i.e., a “binary” integer) and print its decimal equiva- 
lent. Appendix C, Number Systems, discusses the binary number system. (Hint: Use the modulus and 
division operators to pick off the “binary” number' s digits one at a time from right to left. Just as in 
the decimal number system, where the rightmost digit has the positional value 1 and the next digit 
leftward has the positional value 10, then 100, then 1000, etc., in the binary number system, the right¬ 
most digit has a positional value 1, the next digit leftward has the positional value 2, then 4, then 8, 
etc. Thus, the decimal number 234 can be interpreted as 2 * 100 + 3* 10+ 4*1. The decimal equiv- 
alent of binary 1101 is 1 *8 + l*4 + 0*2+l * 1.) 

3.6 The factorial of a nonnegative integer n is written n ! (pronounced “« factorial”) and is defined 
as follows: 

n\ = n ■ (n - 1) • (n - 2) • ... • 1 (for values of n greater than or equal to 1) 

and 

n\ = 1 (for n = 0). 

For example, 5! = 5 ■ 4 ■ 3 • 2 • 1, which is 120. Factorials increase in size very rapidly. What is the 
largest factorial that your program can calculate before leading to an overflow error? 

a) Write a program that reads a nonnegative integer and computes and prints its factorial. 
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b) Write a program that estimates the value of the mathematical constant e by using the for¬ 
mula [Note: Your program can stop after summing 10 terms.] 


e 


i + l + l + ! 

1! 2! 3! 


+ ... 


c) Write a program that computes the value of e x by using the formula [Note: Your program 
can stop after summing 10 terms.] 


= 1 + - + - + —+ . 

1! 2! 3! 


3.7 Write a program that prints the following pattems separately, one below the other each pat- 
tern separated from the next by one blank line. Use for loops to generate the patterns. Ali asterisks 
(*) should be printed by a single statement of the form 


print 1 * 1 , 


(which causes the asterisks to print side by side separated by a space). ( Hint: The last two patterns 
require that each line begin with an appropriate number of blanks.) Extra credit: Combine your code 
from the four separate problems into a single program that prints ali four patterns side by side by 
making elever use of nested for loops. For all parts of this program—minimize the numbers of 
asterisks and spaces and the number of statements that print these characters. 




3.8 (Pythagorean Triples) A right triangle can have sides that are all integers. The set of three 
integer values for the sides of a right triangle is called a Pythagorean triple. These three sides must 
satisfy the relationship that the sum of the squares of two of the sides is equal to the square of the 
hypotenuse. Find all Pythagorean triples for sidel, side2 and hypotenuse all no larger than 20. 
Use a triple-nested f or-loop that tries all possibilities. This is an example of “brute force” comput- 
ing. You will learn in more advanced computer Science courses that there are many interesting prob¬ 
lems for which there is no known algorithmic approach other than sheer brute force. 
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Objectives 

• To understand how to construet programs rnodularly 
from small pieces called functions. 

• To create new functions. 

• To understand the mechanisms of exchanging 
information between functions. 

• To introduce simulation techniques using random 
nurnber generation. 

• To understand how the visibility of identifiers is 
limited to specific regions of programs. 

• To understand how to write and use recursive 
functions, i.e., functions that call themselves. 

• To introduce default and keyword arguments. 

Form everfollows function. 

Louis Henri Sullivan 

E pluribus unum. 

(One composed ofmany.) 

Virgil 

O! call back yesterday, bid time return. 

William Shakespeare 

Richard 11 

When you call me that, smile. 

Owen Wister 





-s* 


rm 
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4.1 Introduction 

Most computer programs that solve real-world problems are larger than the programs pre- 
sented in the previous chapters. Experience has shown that the best way to develop and 
maintain a large program is to construet it from smaller pieces or components, each of 
which is more manageable than the original program. This technique is called divide and 
conquer. This chapter describes many features of the Python language that facilitate the de- 
sign, implementation, operation and maintenance of large programs. 

4.2 Program Components in Python 

Program components in Python are called functions, classes, modules and packages. Typi- 
cally, Python programs are written by combining programmer-defined (programmer-creat- 
ed) functions and classes with functions or classes already available in existing Python 
modules. A module is a file that contains definitions of functions and classes. Many mod¬ 
ules can be grouped together into a collection, called a package. In this chapter, we concen- 
trate on functions and we introduce modules and packages; we discuss classes in detail in 
Chapter 7, Object-Based Programing. 

Programmers can define functions to perform specific tasks that exeeute at various 
points in a program. These functions are referred to as programmer-defined functions. The 
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actual statements defining the function are written only once, but may be called upon “to 
do their job” from many points throughout a program. Thus functions are a fundamental 
unit of Software reuse in Python because functions allow us to reuse program code. 

Python modules provide functions that perform such common tasks as mathematical 
calculations, string manipulations, character manipulations, Web programming, graphics 
programming and many other operations. These functions simplify the programmer’s 
work, because the programmer does not have to write new functions to perform common 
tasks. A collection of modules, the Standard library. is provided as part of the core Python 
language. These modules are located in the library directory of the Python installation (e.g., 
/usr/lib/python2.2 or /usr/local/lib/python2.2 on Unix/Linux; \Python\Lib or 
\Python22\Lib on Windows). 

Just as a module groups related definitions, a package groups related modules. The 
package as a whole provides tools to help the programmer accomplish a general task (e.g., 
graphics or audio programming). Each module in the package defines classes, functions or 
data that perform specific, related tasks (e.g., creating colors, processing . wav files and the 
like). This text introduces many available Python packages, but creating a robust package 
is a Software engineering exercise beyond the scope of the text. 



Good Programming Practice 4.1 

Familiarize yourselfwith the collection of functions and classes in the core Python modules. 








Avoid “reinventing the wheel”. When possible, use Standard libraiy module functions in- 
stead ofwriting new functions. This reduces program development time and increases reli- 
ability, because you are using well-designed, well-tested code. 



Portability Tip 4.1 

Using the functions in the core Python modules usually makes programs more portable. 



Performance Tip 4.1 

Do not try to rewrite existing module functions to make them more efficient. These functions 
are written to perform well. 


A function is invoked (i.e., made to perform its designated task) by a function call. 
The function call speciftes the function name and provides information (as arguments ) 
that the called function needs to perform its job. A common analogy for this is the hierar- 
chical form of management. A boss (the calling function or caller) requests a worker (the 
called function) to perform a task and return (i.e., report back) the results after performing 
the task. The boss function is unaware of how the worker function performs its designated 
tasks. The worker might call other worker functions, yet the boss is unaware of this deci- 
sion. We will discuss how “hiding” implementation details promotes good Software engi¬ 
neering. Figure 4.1 shows the boss function communicating with worker functions 
workerl, worker2 and worker3 in a hierarchical manner. Note that workerl acts 
as a boss function to worker4 and worker5. The boss function when calling 
workerl need not know about workerl’ s relationship with worker4 and worker5. 
Relationships among functions might not always be a hierarchical structure like the one in 
this figure. 
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Fig. 4.1 Hierarchical boss-function/worker-function relationship. 


4.3 Functions 

Functions allow the programmer to modularize aprogram. AU variables created in function 
definitions are local variables —they are known only to the function in which they are de- 
clared. Most functions have a list of parameters (which are also local variables) that pro¬ 
vide the means for communicating information between functions. 

There are several motivations for “functionalizing” a program. The divide-and-conquer 
approach makes program development more manageable. Another motivation is Software 
reusability —using existing functions as building blocks for creating new programs. Software 
reusability is a major benefit of object-oriented programming as we will see in Chapter 7, 
Object-Based Programming, Chapter 8, Customizing Classes, and Chapter 9, Object-Based 
Programming: Inheritance. With good function naming and definition, programs can be cre¬ 
ated from standardized functions that accomplish specific tasks, rather than having to write 
customized code for every task. A third motivation is to avoid repeating code in a program. 
Packaging code as a function allows the code to be executed in several locations just by 
calling the function rather than rewriting it in every instance it is used. 



Each function should be limited to performing a single, well-defined task, and the function 
name should effectively express that task. This promotes Software reusability. 


.Ifyou cannot choose a concise name that expresses a function’ s task, it is possible that the 
-function is performing too many diverse tasks. Usually, itis best to divide such a function into 
smaller functions. 


4.4 Module math Functions 

A module contains function definitions and other elements (e.g., class definitions) that per- 
form related tasks. The math module contains functions that allow programmers to per- 
form certain mathematical calculations. We use various math module functions to 
introduce the concept of functions and modules. Throughout this text, we discuss many oth¬ 
er functions in the core Python modules. 

Generally, functions are invoked by writing the name of the function, followed by a 
left parenthesis, followed by the argument (or a comma-separated list of arguments) being 
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passed to the function, followed by a right parenthesis. To use a function that is defined in 
a module, a program must import the module, using keyword import. After the module 
has been imported, the program can invoke functions in that module, using the module’s 
name, a dot (.) and the function call (i.e., moduleName .functionName ()). The interactive 
session in Fig. 4.2 demonstrates how to print the square root of 900 using the math 
module. 

When the line 


print math.sqrt( ) 

executes, the math module’s function sqrt calculates the square root of the number con- 
tained in the parentheses (e.g., 900). The number 900 is the argument of the math. sqrt 
function. The function returns (i.e., gives back as a resuit) the floating-point value 30.0, 
which is displayed on the screen. 

When the line 


print math.sqrt( ) 


executes, the function call generates an error, also called an exception, because function 
sqrt cannot handle a negative argument. The interpreter displays information about this 
error to the screen. Exceptions and exception handling are discussed in Chapter 12, Excep¬ 
tion Handling. 


Common Programming Error 4.1 



Failure to import the math module when using math module functions is a runtime error. 
A program must import each module before using its functions and variables. 



Common Programming Error 4.2 


When a module is imported via an import statement, forgetting to prefix one of its functions 
with the module name is a runtime error. 


Function arguments can be values, variables or expressions. If cl = 13.0, d = 3.0 
and f = 4.0, then the statement 


print math.sqrt( cl + d * f ) 

calculates and prints the square root of 13.0 + 3.0*4.0 = 25.0, (namely, 5.0). Some 
other math module functions are summarized in Fig. 4.3. {Note: Some results are rounded.) 


Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 
win32 

Type "help", "Copyright", "credits" or "license" for more informa¬ 
tion. 

>>> import math 

>>> print math.sqrt( 900 ) 

30.0 

>>> print math.sqrt( -900 ) 

Traceback (most recent call last): 

File "<stdin>", line 1, in ? 

ValueError: math domain error 








Fig.4.2 Function sqrt of module math. 
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Method 

Desc ription 

Example 

acos ( x ) 

Trigonometric arc cosine of x 
(resuit in radians) 

acos ( 1.0 ) is 0.0 

asin( x ) 

Trigonometric arc sine of x 
(resuit in radians) 

asin ( 0.0) is 0.0 

atan( x ) 

Trigonometric arc tangent of x 
(resuit in radians) 

atan ( 0.0) is 0.0 

ceil( x ) 

Rounds x to the smallest integer 
not less than x 

ceil ( 9.2 ) is 10.0 
ceil ( -9.8 ) is -9.0 

cos( x ) 

Trigonometric cosine of x 
(x in radians) 

cos ( 0.0 ) is 1.0 

exp( x ) 

Exponential function e? 

exp ( 1.0 ) is 2.71828 
exp ( 2.0 ) is 7.38906 

fabs ( x ) 

Absolute value of x 

fabs ( 5.1 ) is 5.1 
fabs ( -5.1 ) is 5.1 

floor( x ) 

Rounds x to the largest integer not 
greater than x 

f loor ( 9.2 ) is 9.0 
f loor ( -9.8 ) is -10.0 

fmod( x, y ) 

Remainder of x/y as a floating 
point number 

fmod ( 9.8, 4.0 ) is 1.8 

hypot( x, y ) 

hypotenuse of a triangle with sides 
of length x and y: sqrt( x 2 + y 2 ) 

hypot (3.0, 4.0) is 5. 

log( x ) 

Natural logarithm of x (base e) 

log ( 2.718282 ) is 1.0 
log ( 7.389056 ) is 2.0 

loglO ( x ) 

Logarithm of x (base 10) 

loglO ( 10.0 ) is 1.0 
loglO ( 100.0 ) is 2.0 

pow( x, y ) 

x raised to power y (x y ) 

pow ( 2.0, 7.0 ) is 12 8 . 
pow (9.0, .5) is 3.0 

sin( x ) 

trigonometric sine of x 
(x in radians) 

sint 0.0 ) is 0.0 

sqrt( x ) 

square root of x 

sqrt ( 900.0 ) is 30.0 
sqrt ( 9.0) is 3.0 

tan( x ) 

trigonometric tangent of x 
(x in radians) 

tan ( 0.0 ) is 0.0 



Fig. 4.3 math module functions 

4.5 Function Definitioris 

Each program we have presented thus far has consisted of a series of statements that some- 
times called predefined Python functions to accomplish the program’s tasks. We refer to 
these statements as the main portion ofthe program for the duration of the book, to differ¬ 
entiate it from the part of the program that contains function definitions. We now discuss 
how programmers write customized functions. 
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In programs containing many functions, the main portion ofthe program should be imple- 
mented as a group ofcalls tofimctions that perform the bulk ofthe program ’s work. 


Consider a program, with a user-defined function square, that calculates the squares 
of the integers from 1 to 10 (Fig. 4.4). Functions must be defined before they are used. 



Good Programming Practice 4.2 

Place a blank line between function definitions to separate the functions and enhance pro¬ 
gram readability. 


Line 9 of the main program invokes function square (defined at lines 5-6) with the 
statement 


print square( x ), 


Function square receives a copy of x in the parameter y. 1 Then square calculates 
y * y (line 6). The resuit is returned to the statement that invoked square. The function 
call (line 9) evaluates to the value returned by the function. This value is displayed by the 
print statement. The value of x is not changed by the function call. This process is re- 
peated 10 times using the for repetition structure. 

The format of a function definition is 


def function-name ( parameter-list ) : 
statements 


where function-name is any valid identifier, and parameter-list is a comma-separated list of 
parameter names received by function-name. If a function does not receive any values, the pa¬ 
rameter list is empty, but the parentheses are stili required. The indented statements that fol- 
low a def statement form the function body. The function body is referred to as a block. 


1 # Fig. 4.4: fig04_04.py 

2 # Creating and using a programmer-defined function. 

3 

4 # function definition 

5 def square( y ): 

6 return y * y 

7 

8 for x in range( , ): 

9 print square( x ), 

10 

11 print 


1 4 9 16 25 36 49 64 81 100 


Fig. 4.4 Programmer-defined function. 


1. Actually, y receives a reference to x, but y behaves as if it were a copy of x’s value. This is the 
concept of pass-by-object-reference, which we introduce in Chapter 5, Lists, Tuples and Dictio- 
naries. 
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Common Programming Error 4.3 

Failure toplace a colon (:) after a function’sparameter list is a syntax error. 



Common Programming Error 4.4 

The pair of parentheses () in a function call is a Python operator. It causes the function to 
be called. The function is not invoked if the parentheses are missing from a function call. 
Normally, control passes through the statement. If a print statement includes a function 
call without parentheses, it displays the memory location of the function. Ifthe user intends 
to assign the resuit of a function call to a variable, a function call without parentheses binds 
the function itselfto the variable. 



Common Programming Error 4.5 

Failure to indent the body of a function is a syntax error. 



Good Programming Practice 4.3 

It is not advisable to use identical namesfor the arguments passed to a function and the cor- 
responding parameters in the function definition. 




Good Programming Practice 4.4 


Choosing meaningful function names and meaningful parameter names ensures program 
readability and reduces the amount of comments. Writing programs this way creates “self- 
commenting code. ” 


Ifpossible, a function shouldfit in an editor window. Regardless ofthe length of a function, 
it should perform one task well. Small functions promote Software reusability. 



Testing and Debugging Tip 4.1 

Updating a function is easier than updating repeated code throughout a program. 



Programs should be written as collections of small functions. This makes programs easier to 
write, debug, maintain and modify. 



A function requiring a large number of parameters might be performing too many tasks. Con- 
sider dividing the function inio smaller functions that perform separate tasks. The function’s 
de f statement should fit on one line, ifpossible. 


When a function completes its task, the function retums control to the caller. There are 
three ways to return control to the point from which a function was invoked. If the function 
does not return a resuit explicitly, control is returned either when the last indented line is 
reached or upon execution of the statement 


return 

In either case, the function returns None , a Python value that represents null—indicating 
that no value has been declared—and evaluates to false in conditional expressions. 
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If the function does return a resuit, the statement 
retura expressiori 

returns the value of expressiori to the caller. 

Our second example (Fig. 4.5) uses a programmer-defined function, maximum- 
Value. This function is independent of the type of its arguments. We use function max- 
imumValue to determine and return the largest of three integers, the largest of three floats 
and the largest of three strings. 

Line 15 combines two function calls— raw input and int —into one statement. In 
this case, function raw_input reads a value from the user, then the resuit is passed to 
function int as an argument. The call to function maximumValue (line 20) passes the 
three integers to the programmer-defined function (lines 4-13). The return statement in 
maximumValue (line 13) returns the largest integer value to the main program. The 
print statement (line 20) displays the returned value. The same function also returns the 
maximum float (line 26) and the maximum string (line 32). 







1 

# Fig. 4.5: fig04 05.py 


2 

# Finding the maximum of 

three integers. 

3 



4 

def maximumValue( x, y, z 

) : 

5 

maximum = x 


6 



7 

if y > maximum: 


8 

maximum = y 


9 



10 

if z > maximum: 


11 

maximum = z 


12 



13 

return maximum 


14 



15 

a = int( raw input( 

) ) 

16 

b = int( raw input( 

) ) 

17 

c = int( raw input( 

) ) 

18 



19 

# function call 


20 

print "Maximum integer is 

, maximumValue! a, b, c ) 

21 

print # print new line 


22 



23 

d = float ( raw input( 

) ) 

24 

e = float( raw input( 

) ) 

25 

f = float( raw input( 

) ) 

26 

print "Maximum float is: 

, maximumValue! d, e, f ) 

27 

print 


28 



29 

g = raw input( 

) 

30 

h = raw input( 

) 

31 

i = raw input ( 

) 

32 

print Maximum : 

, maximumValue! g, h, i ) 


Fig. 4.5 Programmer-defined maximum function. (Part 1 of 2.) 
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Enter first integer 

: 27 

Enter second integer: 12 

Enter third integer 

: 36 

Maximum integer is: 

36 

Enter first float: 

12.3 

Enter second float: 

45.6 

Enter third float: 

9.03 

Maximum float is: 

45.6 

Enter first string: 

hello 

Enter second string 

: programming 

Enter third string: 

goodbye 

Maximum string is: 

programming 


Fig. 4.5 Programmer-defined maximum function. (Part 2 of 2.) 


4.6 Random-NumberGeneration 




We now take a brief diversion into a popular programming applicatiori—simulation and 
game playing—to illustrate most of the control structures we have studied. In this and the 
next section, we develop a game-playing program that incorporates multiple functions. 

There is something in the air of a gambling casino that invigorates every type of person 
from the high-rollers at the plush mahogany-and-felt craps tables to the quarter-poppers at 
the one-armed bandits. It is the element ofchance, the possibility that luck will convert a 
pocketful of money into a mountain of wealth, is what drives scores of people to gambling 
casinos. The element of chance can be introduced into computer applications through 
module random. 

Function random. randrange generates an integer in the range of its first argument 
upto, but not including, its second argument. If randrange truly produces integers at 
random, every number in that range has an equal chance (or probability) of being chosen 
each time the function is called. 

Figure 4.6 displays the results of 20 rolls of a six-sided die to demonstrate module 
random. Function call random. randrange ( 1,7) produces integers in the range 1-6. 


i 

# Fig. 4.6: fig04 

0 6 .py 

2 

# Random integers 

produced by randrange. 

3 



4 

import random 


5 



6 

for i in range( , 

): # simulates 20 die rolls 

7 

print % 

( random.randrange( , ) ), 

8 



9 

if i % == : 

# print newline every 5 rolls 

10 

print 



Fig. 4.6 Random integensproduced by random. randrange ( 1, 7 ). (Parti 
of 2.) 
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Fig. 4.6 Random integersproduced by random. randrange ( 1, 7 ) . (Part 2 
of 2.) 


To show that these numbers occur with approximately equal likelihood, let us simulate 
6000 rolls of a die (Fig. 4.7). Each integer from 1 to 6 should appear approximately 1000 
times. 




1 

# Fig. 4.7: fig04 

07. py 


2 

# Roll a six-sided die 6000 times. 


3 




4 

import random 



5 




6 

frequencyl = 



7 

frequency2 = 



8 

frequency3 = 



9 

frequency4 = 



10 

frequency5 = 



11 

frequency6 = 



12 




13 

for roll in range( , ) : 

# 6000 die rolls 

14 

face = random. 

randrange( , ) 


15 




16 

if face == : 


# frequency counted 

17 

frequencyl 

+ = 


18 

elif face == 

: 


19 

frequency2 

+ = 


20 

elif face == 

: 


21 

frequency3 

+ = 


22 

elif face == 

: 


23 

frequency4 

+ = 


24 

elif face == 

: 


25 

frequency5 

+ = 


26 

elif face == 

: 


27 

frequency6 

+ = 


28 

else : 


# simple error handling 

29 

print shou 



30 




31 

print 

% 


32 

print 

% frequencyl 


33 

print 

% frequency2 


34 

print 

% frequency3 


35 

print 

% frequency4 


36 

print 

% frequencyS 


37 

print 

% frequency6 







Fig. 4.7 Rolling a six-sided die 6000times. (Partiof 2.) 
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Face Frequency 

1 946 

2 1003 

3 1035 

4 1012 

5 987 

6 1017 


Fig. 4.7 Rolling a six-sided die 6000 times. (Part2of 2.) 


As the program output shows, function random. randrange simulates the rolling 
of a six-sided die. Note that program execution should not reach the e Ise condition (lines 
28-29) provided in the if/elif/else structure, but we provide the condition for good 
practice. 



Testing and Debugging Tip 4.2 

Provide a default else case in an if/elif/else to catch errors even ifyou absolutelv 
are certain that the program contains no hugs! 







4.7 Example: A Game of Chance 

One of the most popular games of chance is a dice game known as “craps,” which is played 
in casinos and back alleys throughout the world. The rules of the game are straightforward: 

A player rolls two dice. Each die has six faces. These faces contain 1, 2, 3, 4, 5 and 6 spots. 
After the dice have come to rest, the sum ofthe spots on the two upward faces is calculated. 
Ifthe sum is 7 or 11 on thefirst throw, the player wins. Ifthe sum is 2, 3 or 12 on thefirst 
throw (called “craps”), the player loses (i.e., the “house” wins). Ifthe sum is 4, 5, 6, 8, 9 or 
10 on thefirst throw, then that sum becomes the player’s “point. ” To win, you must continue 
rolling the dice until you “make vour point. ” The player loses by rolling a 7 before making 
the point. 

The program in Fig. 4.8 simulates the game of craps and shows several sample executions. 


1 

# Fig. 4.8: fig04 08.py 



2 

# Craps. 



3 




4 

import random 



5 




6 

def rollDice (): 



7 

diei = random.randrange( , 

) 


8 

die2 = random.randrange( , 

) 


9 

workSum = diei + die2 



10 

print "Player rolled %d + %d 


% ( diei, die2, workSum ) 

11 




12 

return workSum 



13 




14 

sum = rollDice() 


# first dice roll 

15 





Fig. 4.8 Game of craps. (Part 1 of 2.) 
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16 

if sum == or sum == 

: 


# win on first roll 

17 

gameStatus = 




18 

elif sum == or sum 

== or sum 

= = 

L2 : # lose on first roll 

19 

gameStatus = 




20 

else : 



# remember point 

21 

gameStatus = 




22 

myPoint = sum 




23 

print 3" , 

myPoint 



24 





25 

while gameStatus == 

: 

# 

keep rolling 

26 

sum = rollDice () 




27 





28 

if sum == myPoint: 


# 

win by making point 

29 

gameStatus = 




30 

elif sum == : 


# 

lose by rolling 7: 

31 

gameStatus = 




32 





33 

if gameStatus == 

: 



34 

print "Player wins 




35 

else : 




36 

print "Player lose 







Notice that the player must roll two dice on each roll. Function rollDice simulates 
rolling the dice (lines 6-12). Function rollDice is defined once, but it is called from two 
places in the program (lines 14 and 26). The function takes no arguments, so the parameter 
list is empty. Function rollDice prints andreturns the sum of the two dice (lines 10-12). 
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The game is reasonably involved. The player could win or lose on the first roll or on 
any subsequent roll. The variable gameStatus keeps track of the win/loss status. Vari- 
able gameStatus is one of the strings "WON", "LOST" or "CONTINUE". When the 
player wins the game, gameStatus is set to "WON" (lines 17 and 29). When the player 
loses the game, gameStatus is set to "LOST" (lines 19 and 31). Otherwise, 
gameStatus is set to "CONTINUE", allowing the dice to be rolled again (line 21). 

If the game is won or lost after the first roll, the body of the whi 1 e structure (lines 25- 
31) is skipped, because gameStatus is not equal to "CONTINUE" (line 25). Instead, the 
programproceeds to the if/else structure (lines 33-36), which prints "Player wins" 
if gameStatus equals "WON", but "Player loses" if gameStatus equals 
"LOST". 

If the game is not won or lost after the first roll, the value of sum is assigned to variable 
myPoint (line 22). Execution proceeds with the while structure, because gameStatus 
equals "CONTINUE". During each iteration of the while loop, rollDice is invoked to 
produce a new sum (line 26). If sum matches myPoint, gameStatus is set to "WON" 
(lines 28-29), the while test fails (line 25), the if/else structure prints "Player 
wins " (lines 33-34) and execution terminates. If sum is equal to 7, gameStatus is set 
to "LOST" (lines 30-31), the while test fails (line 25), the if/else statement prints 
"Player loses" (lines 35-36) and execution terminates. Otherwise, the while loop 
continues executing. 

Note the use of the various program-control mechanisms discussed earlier. The craps 
program uses one programmer-defined function— rollDice —and the while, if/else 
and if/elif/else structures. The program uses both stacked control structures (the if/ 
elif/else in lines 16-23 and the while in lines 25-31) and nested control structures 
(the if/elif in lines 28-31 is nested inside the while in lines 25-31). 

4.8 Scope Rules 2 

Until now, we have not discussed how a Python program Stores and retrieves a variable’s 
value. It appears that the value is simply “there” when the program needs it. In fact, Python 
has striet rules that describe how and when a variable’s value can be accessed. These rules 
are described in terms of namespaces and scopes. In this section, we discuss how 
namespaces and scopes affect a program’s execution. 

We use an example to explain these concepts. Assume that a function contains the fol- 
lowing line of code: 

print x 

Before a value can be printed to the screen, Python must first find the identifier named x 
and determine the value associated with that identifier. Namespaces store information 
about an identifier and the value to which it is bound. Python defines three namespaces— 
local, global and built-in. When a program attempts to access an identifier’s value, Python 
searches the namespaces in a certain order—local, global and built-in namespaces—to see 
whether and where the identifier exists. 


2. Nested scopes are not discussed in this text. Nested scopes are a complex topic and were optional 
in Python 2.1 but are mandatory in Python 2.2. Information about nested scopes can be found in 

PEP 227 at www.python.org/peps/pep-02 27.html. 
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The first namespace that Python searches is the local namespace , which Stores bind- 
ings created in a block. Function bodies are blocks, so ali function parameters and any iden- 
tifiers the function creates are stored in the function’s local namespace. Each function has 
a unique local namespace—one function cannot access the local namespace of another 
function. In the example above, Python first searches the function’s local namespace for an 
identifier named x. If the function’s local namespace contains such an identifier, the func¬ 
tion prints the value of x to the screen. If the function’s local namespace does not contain 
an identifier named x (e.g., the function does not define any parameters or create any iden- 
tifiers named x), Python searches the next outer namespace—the global namespace (some- 
times called the module namespace). 

The global namespace contains the bindings for ali identifiers, function names and 
class names defined within a module or file. Each module or file’s global namespace con¬ 
tains an identifier called_ name _that States the module’s name (e.g., "math" or 

"random"). When a Python interpreter session starts or when the Python interpreter 

begins executing a program stored in a file, the value of_ name _is "_ main _". In 

the example above, Python searches for an identifier named x in the global namespace. If 
the global namespace contains the identifier (i.e., the identifier was bound to the global 
namespace before the function was called), Python stops searching for the identifier and the 
function prints the value of x to the screen. If the global namespace does not contain an 
identifier named x, Python searches the next outer namespace—the built-in namespace. 

The built-in namespace contains identifiers that correspond to many Python functions 
and error messages. For example, functions raw_input, int and range belong to the 
built-in namespace. Python creates the built-in namespace when the interpreter starts, and 
programs normally do not modify the namespace (e.g., by adding an identifier to the 
namespace). In the example above, the built-in namespace does not contain an identifier 
named x, so Python stops searching and prints an error message stating that the identifier 
could not be found. 

An identifier’s scope describes the region of a program that can access the identifier’s 
value. If an identifier is defined in the local namespace (e.g., in a function), all statements 
in the block may access that identifier. Statements that reside outside the block (e.g., in the 
main portion of a program or in another function) cannot access the identifier. Once the 
code block terminates (e.g., after a return statement), all identifiers in that block’s local 
namespace “go out of scope” and are inaccessible. 

If an identifier is defined in the global namespace, the identifier has global scope. A 
global identifier is known to all code that executes, from the point at which the identifier is 
created until the end of the file. Furthermore, if certain criteria are met, functions may 
access global identifiers. We discuss this issue momentarily. Identifiers contained in built- 
in namespaces may be accessed by code in programs, modules or functions. 

One pitfall that can arise in a program that uses functions is called shadowing. When 
a function creates a local identifier with the same name as an identifier in the module or 
built-in namespaces, the local identifier shadows the global or built-in identifier. A logic 
error can occur if the programmer references the local variable when meaning to reference 
the global or built-in identifier. 


Common Programming Error 4.6 






Shadowing an identifier in the module or built-in namespace with an identifier in the local 
namespace may resuit in a logic error. 
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Good Programming Practice 4.5 

Avoid variable names that shadow names in outer scopes. This can be accomplished by 
avoiding the use ofan identifier with the same natne as an identifier in the built-in namespace 
and by avoiding the use of duplicate identifiers in a program. 


Python provides a way for programmers to determine what identifiers are available 
from the current namespace. Built-in function dir returns a list of these identifiers. 
Figure 4.9 shows the namespace that Python creates when starting an interactive session. 
Calling function dir telis us that the current namespace contains three identifiers: 

_builtins_, doc _and name _. The next command in the session prints the 

value for identifier name , to demonstrate that this value is main for an inter¬ 
active session. The subsequent command prints the value for identifier_ builtins_ . 

Notice that we get back a value indicating that this identifier is bound to a module. This 

indicates that the identifier _ builtins _can be used to refer to the module 

_builtin _.We explore this further in Section 4.9. The next command in the interac¬ 
tive session creates a new identifier x and binds it to the value 3. Calling function dir 
again reveals that identifier x has been added to the session’s namespace. 

The interactive session in Fig. 4.9 only hints at a Python program’s powerful ability 
to provide information about the identifiers in a program (or interactive session). This is 
called introspection. Python provides many other introspective capabilities, including func¬ 
tions globals and locals that return additional information about the global and local 
namespaces, respectively. 

Although functions help make a program easier to debug, scoping issues can introduce 
subtle errors into a program if the developer is not careful. The program in Fig. 4.10 dem- 
onstrates these issues, using global and local variables. Line 4 creates variable x with the 
value 1. This variable resides in the global namespace for the program and has global scope. 
In other words, variable x can be accessed and changed by any code that appears after line 
4. This global variable is shadowed in any function that creates a local variable named x. 
In the main program, line 22 prints the value of variable x (i.e., 1). Lines 24—25 assign the 
value 7 to variable x and print its new value. 


Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 
win32 

Type "help", "Copyright", "credits" or "license" for more informa¬ 
tion. 

>>> dir() 

['_builtins_', '_doc_', 1 _name_'] 

>>> print _name_ 

_main_ 

>>> print _builtins_ 

cmodule '_builtin_ 1 (built-in)> 

>>> x = 3 # bind new identifier to global namespace 

>>> dir() 

[' builtins ', 1 doc ', 1 name ', 'x'] 


Fig. 4.9 Function dir. 
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1 

# Fig. 4.10: 

fig04 10.py 

2 

# Scoping example. 

3 



4 

x = 

5 



6 

# alters the 

local variable x, shadows the global variable 

7 

def a(): 


8 

X = 


9 



10 

print \n' 

3"/ X, 1 

11 

X + = 


12 

print "loc 

# X, 

13 



14 

# alters the 

global variable x 

15 

def b(): 


16 

global x 


17 



18 

print \n 

# X, 

19 

x * = 


20 

print "glc 

/ X, 

21 



22 

print 

/ X 

23 



24 

X = 


25 

print oba 

, X 

26 



27 

a() 


28 

b () 


29 

a() 


30 

b() 


31 



32 

print “\ngloi 

/ X 


global x is 1 
global x is 7 

local x in a is 25 after entering a 

local x in a is 26 before exiting a 

global x is 7 on entering b 
global x is 70 on exiting b 

local x in a is 25 after entering a 

local x in a is 26 before exiting a 

global x is 70 on entering b 
global x is 700 on exiting b 

global x is 700 


Fig. 4.10 Scopesand keywond global. 

The program defines two functions that neither receive nor return any arguments. 
Function a (lines 7-12) declares a local variable x and initializes it to 25. Then, function a 
prints local variable x, increments it and prints it again (lines 10-12). Each time the pro- 
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gram invokes the function, function a recreates local variable x and initializes the variable 
to 25, then increments it to 26. 

Function b (lines 15-20) does not declare any variables. Instead, line 16 designates x 
as having global scope with keyword global. Therefore, when function b refers to vari¬ 
able x, Python searches the global namespace for identifier x. When the program first 
invokes function b (line 28), the program prints the value of the global variable (7), multi- 
plies the value by 10 and prints the value of the global variable (70) again before exiting 
the function. The second time the program invokes function b (line 30), the global variable 
contains the modified value, 70. Finally, line 32 prints the global variable x in the main pro¬ 
gram again (700) to show that function b has modified the value of this variable. 

4.9 Keyword import and Namespaces 

We have discussed how to import a module and use the functions defined in that module. 
In this section, we explore how importing a module affects a program’ s namespace and dis- 
cuss various ways to import modules into a program. 


4.9.1 Importing one or more modules 


Consider a program that needs to perform one of the specialized mathematical operations 
defined in module math. The program must first import the module with the line 

import math 

The code that imports the module now has a reference to the math module in its 
namespace. After the import statement, the program may access any identifiers defined 
in the math module. 

The interactive session in Fig. 4.11 demonstrates how an import statement affects 
the session’s namespace and how a program can access identifiers defined in a module’s 
namespace. The first line imports the math module. The next line then calls function dir, 
to demonstrate that the identifier math has been inserted in the session’s namespace. As 
the subsequent print statement shows, the identifier is bound to an object that represents 
the math module. If we pass identifier math to function dir, the function returns a list of 
all the identifiers in the math module’s namespace. [IVofe: Earlier versions of Python may 
output different results for dir ().] 

The next command in the session invokes function sqrt. To access an identifier in 
the math module’s namespace, we must use the dot (.) access operator. The line 


math.sqrt( ) 

first accesses (with the dot access operator) function sqrt defined in the math module’s 
namespace. The line then invokes (with the parentheses operator) the sqrt function, pass- 
ing an argument of 9.0. 

If a program needs to import several modules, the program can include a separate 
import statement for each module. A program can also import multiple modules in one 
statement, by separating the module names with commas. Each imported module is added 
to the program’s namespace as demonstrated in the interactive session of Fig. 4.12. 


3. Actually, function dir returns a list of attributes for the object passed as an argument. In the case of a module, 
this information amounts to a list of all identifiers (e.g., functions and data) defined in the module. 
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Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 
win32 

Type "help", "Copyright", "credits" or "license" for more Informa¬ 
tion. 

>>> import math 
>>> dir() 

[' builtins ', 1 doc ', 1 name ', 'math'] 

>>> print math 

cmodule 'math' (built-in)> 

>>> dir( math ) 

[' doc ', 1 name ', 'acos', 'asin 1 , 'atan', 1 atan2', 'ceil', 

'cos', 'cosh','e', 'exp', 'fabs 1 , 'floor', 'fmod', 'frexp', 'hy- 
pot', 1 ldexp', 'log', 'loglO 1 ,'modf 1 , 'pi', 'pow', 'sin', 'sinh', 

'sqrt', 'tan', 'tanh'] 

>>> math.sqrt( 9.0 ) 

3.0 


Fig. 4.11 Importing a module. 



4.9.2 Importing identifiers from a module 

In the previous example, we discussed how to access an identifier defined in another mod¬ 
ulet namespace. To access that identifier, the programmer must use the dot (.) access op¬ 
erator. Sometimes, a program uses only one or a few identifiers from a module. In this case, 
it may be useful to import only those identifiers the program needs. Python provides the 
from/import statement to import one or more identifiers from a module directly into the 
program’s namespace. 

The interactive session in Fig. 4.13 imports the sqrt function directly into the ses¬ 
sioni namespace. When the interpreter executes the line 

from math import sqrt 

the interpreter creates a reference to function math. sqrt and places the reference direct¬ 
ly into the sessioni namespace. Now, we can call the function directly without using the 
dot operator. Just as a program can import multiple modules in one statement, a program 
can import multiple identifiers from a module in one statement. The line 

from math import sin, cos, tan 

imports math functions sin, cos and tan directly into the sessioni namespace. After 
the import statement, a call to function dir reveals references to each of these functions. 
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The interactive session in Fig. 4.14 demonstrates that a program also may import all 
identifiers defined in a module. The statement 


from math import * 


imports all identifiers that do not start with an underscore from the math module into the 
interactive session’s namespace. Now the programmer can invoke any of the functions 
from the math module, without accessing the function through the dot access operator. 
However, importing a module’s identifiers in this way can lead to serious errors and is con- 
sidered a dangerous programming practice. Consider a situation in which a program had 
defined an identifier named e and assigned it the string value " e ". After executing the pre- 
ceding import statement, identifier e is bound to the mathematical floating-point con¬ 
stant e, and the previous value for e is no longer accessible. In general, a program should 
never import all identifiers from a module in this way. 



Testing and Debugging Tip 4.3 

In general, avoid importing all identifiers from a module into the namespace of another mod¬ 
ule. This method of importing a module should be used onlyfor modules provided by trusted 
sources, whose documentation explicitly States that such a statement may be used to import 


the module. 


Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 
win32 

Type "help", "Copyright", "credits" or "license" for more informa- 
tion. 

>>> from math import * 

>>> dir() 

['_builtins_', 1 _doc_', 1 _name_', 'acos', 'asin', 1 atan', 

'atan2 1 , 'ceil', 'cos', 1 cosh', 'e', 'exp', 'fabs', 'floor', 

'fmod', 'frexp', 'hypot 1 , 'ldexp 1 ,'log 1 , 'loglO', 'modf', 'pi', 
'pow', 'sin', 'sinh 1 , 'sqrt 1 , 'tan', 'tanh'1 








Fig. 4.14 Importing all identifiers from a module. 
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4.9.3 Binding names for modules and module identifiers 

We have already seen how a program can import a module or specific identifiers from a mod¬ 
ule. Python’s syntax gives the programmer considerable control over how the import state- 
ment affects a program’s namespace. In this section, we discuss this control in more detail 
and explain further how the programmer can customize the references to imported elements. 
The statement 

import random 

imports the random module and places a reference to the module named random in the 
namespace. In the interactive session in Fig. 4.15, the statement 

import random as randomModule 

also imports the random module, but the as clause of the statement allows the program¬ 
mer to specify the name of the reference to the module. In this case, we create a reference 
named randomModule. Now, if we want to access the random module, we use refer¬ 
ence randomModule. 

A program can also use an import/as statement to specify a name for an identifier 
that the program imports from a module. The line 

from math import sqrt as squareRoot 

imports the sqrt function from module math and creates a reference to the function 
named squareRoot. The programmer may now invoke the function with this reference. 

Typically, module authors use import/as statements, because the imported element 
may deftne names that conflict with identifiers already defined by the authofs module. With 
the import/as statement, the module author can specify a new name for the imported ele¬ 
ments and thereby avoid the naming conflict. Programmers also use the import/as state¬ 
ment for convenience. A programmer may use the statement to rename a particularly long 
identifier that the program uses extensively. The programmer specifies a shorter name for the 
identifier, thus increasing readability and decreasing the amount of typing. 



Fig. 4.15 Specifying namesforimported elements 
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Python’s capabilities for importing elements into a program supports component - 
based programming. The programmer should choose syntax Python appropriate for each 
situation, keeping in mind that the goal of component-based programming is to create pro- 
grams that are easier to construet and maintain. 

4.10 Recuision 

The programs we have discussed thus far generally are structured as functions that call one 
another in a disciplined, hierarchical manner. For some problems, however, it is useful to 
have functions call themselves. A recursive function is a function that calls itself, either di- 
rectly or indirectly (through another function). Recursion is an important topic discussed at 
length in upper-level computer-science courses. In this section and the next, we present 
simple examples of recursion. 

We first consider recursion conceptually and then illustrate several recursive func¬ 
tions. Recursive problem-solving approaches have a number of elements in common. A 
recursive function is called to solve a problem. The function actually knows how to solve 
only the simplest case(s), or so-called base case(s). If the function is not called with a base 
case, the function divides the problem into two conceptual pieces—a piece that the function 
knows how to solve (a base case) and a piece that the function does not know how to solve. 
To make recursion feasible, the latter piece must resemble the original problem, but be a 
slightly simpler or slightly smaller version of the original problem. Because this new 
problem looks like the original problem, the function invokes (calls) a fresh copy of itself 
to go to work on the smaller problem; this is referred to as a recursive call and is also called 
the recursion step. The recursion step normally includes the keyword return, because 
this resuit will be combined with the portion of the problem the function knew how to solve 
to form a resuit that will be passed back to the original caller. 

The recursion step exeeutes while the original call to the function is stili open (i.e., 
while it has not finished exeeuting). The recursion step can resuit in many more such recur¬ 
sive calls, as the function divides each new subproblem into two conceptual pieces. For the 
recursion eventually to terminate, the sequence of smaller and smaller problems must con¬ 
verge on a base case. At that point, the function recognizes the base case and returns a resuit 
to the previous copy of the function, and a sequence of returns ensues up the line until the 
original function call eventually returns the final resuit to the caller. This process sounds 
exotic when compared with the conventional problem solving techniques we have used to 
this point. As an example of these concepts at work, let us write a recursive program to per- 
form a popular mathematical calculation. 

The factorial of a nonnegative integer n, written n! (and pronounced “n factorial”), is 
the product 

n ■ (n - 1) • (n - 2) • ... • 1 

with 1! equal to 1, and 0! equal to 1. For example, 5! is the product 5 • 4 • 3 • 2 • 1, which is 
equal to 120. 

The factorial of an integer, number, greater than or equal to 0 can be calculated iter- 
atively (nonrecursively) using for, as follows: 

factorial = 

for counter in range( , number + ): 

factorial *= counter 
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A recursive definition of the factorial function is obtained by observing the following 
relationship: 

n\ =n ■ (n - 1)! 

For example, 5! is clearly equal to 5 * 4!, as is shown by the following equations: 

5! = 5 • 4 • 3 • 2 • 1 

5! = 5 • (4- 3 - 2 • 1) 

5! = 5 • (4!) 

The evaluation of 5! would proceed as shown in Fig. 4.16. Figure 4.16 (a) shows how 
the succession of recursive calls proceeds until 1! evaluates to 1, which terminates the 
recursion. Figure 4.16 (b) shows the values returned from each recursive call to its caller 
until the final value is calculated and returned. 

Figure 4.17 uses recursion to calculate and print the factorials of the integers from 0 
to 10. The recursive function factorial (lines 5-10) first tests to determine whether a 
terminating condition is true (line 7)—if number is less than or equal to 1 (the base case), 
factorial returns 1, no further recursion is necessary and the function terminates. Oth- 
erwise, if number is greater than 1, line 10 expresses the problem as the product of 
number and a recursive call to factorial evaluating the factorial of number - 1. Note 
that factorial ( number - 1 ) is a simpler version of the original calculation, 
factorial ( number ). 

._ n Common Programming Error 4.7 

Either omitting the base case or writing the recursion step incorrectly so that it does not con¬ 
verge on the base case will cause infinite recursion, eventually exhausting memory. This is 
analogous to the problem ofan infinite loop in an iterative (nonrecursive) solution. 




(a) Processiori of recursive calls (b) Values returned from each recursive call 








Fig. 4.16 Recursive evaluation of 5!. 
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1 # Fig. 4.17: fig04_17.py 

2 # Recursive factorial function. 

3 

4 # Recursive definition of function factorial 

5 def factorial ( number ) : 

6 

7 if number <= : 

8 return 

9 else: 

10 return number * factorial ( number - ) 

11 

12 for i in range( ): 

13 print % ( i, factorial( i ) ) 


0 ! 

_ 

1 

1! 

= 

1 

2 ! 

= 

2 

3 ! 

= 

6 

4 ! 

= 

24 

5 ! 

= 

120 

6 ! 

= 

720 

7 ! 

= 

5040 

8 ! 

= 

40320 

9 ! 

= 

362880 

10 ! 

= 

3628800 


Fig. 4.17 Recursive function used to calculate factorials. 

4.11 Example Using Recursion: The Fibonacci Senes 

The Fibonacci series 

0, 1, 1,2, 3,5,8, 13,21, ... 

begins with 0 and 1 and has the property that each subsequent Fibonacci number is the sum 
of the previous two Fibonacci numbers. 

The series occurs in nature, in particular, describing a spiral. The ratio of successive 
Fibonacci numbers converges on a constant value of 1.618.... This number, too, repeatedly 
occurs in nature and has been called the golden ratio , or the golden mean. Flumans tend to 
find the golden mean aesthetically pleasing. Architects often design Windows, rooms, and 
buildings whose length and width are in the ratio of the golden mean. Postcards often are 
designed with a golden-mean length/width ratio. 

The Fibonacci series can be defined recursively as follows: 

fibonacci( 0 ) = 0 
fibonacci( 1 ) = 1 

fibonacci! n ) = fibonacci! n—1 ) + fibonacci! n — 2) 

Note that there are two base cases for the Fibonacci calculation—fibonacci(O) is defined to 
be 0 and fibonacci! 1) is defined to be 1. The programof Fig. 4.18 calculates the / th Fibonac¬ 
ci number recursively, using function fibonacci flines 4-14). Notice that Fibonacci 
numbers increase rapidly. Each output box shows a separate execution of the program. 
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1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 


# Fig. 4.18: fig04_18.py 

# Recursive fibonacci function. 

def fibonacci ( n ) : 
if n < : 

print "Cannot find the fibonacci of a negative 

if n == or n == : 

return n 
else : 

# two recursive calls 

return fibonacci ( n - ) + fibonacci( n - ) 

number = int( raw_input( ) ) 

resuit = fibonacci( number ) 

print % ( number, resuit ) 
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Enter an integer: 20 
Fibonacci(20) = 6765 




Fig.4.18 Recursively generating Fibonacci numbers. (Part 2 of 2.) 

The initial call to fibonacci (line 17) is not a recursi ve call, but all subsequent calls 
to fibonacci performed from the body of fibonacci are recursive. Each time 
fibonacci is invoked, it tests for the base case— n equal to 0 or 1. If this condition is 
true, fibonacci returns n (line 10). Interestingly, if n is greaterthan 1, therecursion step 
generates two recursive calls (line 14), each of which is a simpler problem than the original 
call to fibonacci. Figure 4.19 illustrates fibonacci evaluating fibonacci ( 3 ). 

A word of caution is in order about recursive programs like the one we use here to gen¬ 
erate Fibonacci numbers. Each invocation of the f ibonacci function that does not match 
one of the base cases (i.e., 0 or 1) results in two more recursive calls to fibonacci. This 
set of recursive calls rapidly gets out of hand. Calculating the Fibonacci value of 20 using 
the program in Fig. 4.18 requires 21,891 calls to the fibonacci function; calculating the 
Fibonacci value of 30 requires 2,692,537 calls to the fibonacci function. 

As you try to calculate larger Fibonacci values, you will notice that each consecutive 
Fibonacci number results in a substantial increase in calculation time and number of calls 
to the fibonacci function. For example, the Fibonacci value of 31 requires 4,356,617 
calls, and the Fibonacci value of 32 requires 7,049,155 calls. As you can see, the number 
of calls to fibonacci is increasing quickly—2,692,538 additional calls between Fibonacci 
values of 31 and 32. This difference in number of calls made between Fibonacci values of 
31 and 32 is more than 1.5 times the number of calls for Fibonacci values between 30 and 
31. Computer scientists refer to this as exponential complexity. Problems of this nature 
humble even the world’s most powerful computers! In the field of complexity theory, com¬ 
puter scientists study how hard algorithms work to complete their tasks. Complexity issues 
are discussed in detail in the upper-level computer-science course generally called “Algo¬ 
rithms” or “Complexity.” 


(«) 







Fig. 4.19 Recursive caII to function fibonacci. 
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Performance Tip 4.2 

Avoid Fibonacci-style recursive programs that resuit in an exponential “explosion ” ofcalls. 






4.12 Rec uision vs. Iteration 


In the previous sections, we studied two functions that can be implemented either recur- 
sively or iteratively. In this section, we compare the two approaches and discuss why the 
programmer might choose one approach over the other in a particular situation. 

Both iteration and recursion are based on a control structure: Iteration uses a repetition 
structure (such as for and while); recursion uses a selection structure (such as if and 
if/else). Both iteration and recursion involve repetition: Iteration explicitly uses a rep- 
etition structure; recursion achieves repetition through repeated function calls. Iteration and 
recursion both involve a termination test: Iteration terminates when the loop-continuation 
condi tion fails; recursion terminates when a base case is recognized. Iteration with counter- 
controlled repetition and recursion each gradually approach termination: Iteration keeps 
modifying a counter until the counter assumes a value that makes the loop-continuation 
condi tion fail; recursion keeps producing simpler versions of the original problem until the 
base case is reached. Both iteration and recursion can occur infinitely: An infinite loop 
occurs with iteration if the loop-continuation test never becomes false; infinite recursion 
occurs if the recursion step does not reduce the problem each time in a manner that con¬ 
verges on the base case. 

Recursion has many negatives. It repeatedly invokes the mechanism and, conse- 
quently, the overhead of function calls. This repetition can be expensive in both processor 
time and memory space. Each recursive call causes another copy of the function (actually 
only the function’s variables) to be created; this set of copies can consume considerable 
memory. Iteration normally occurs within a function, so the overhead of repeated function 
calls and extra memory assignment is omitted. So why choose recursion? 



Any problem that can be solved recursively can also be solved iteratively (nonrecursively). 
A recursive approach normally is preferred over an iterative approach when the recursive 
approach more naturally mirrors the problem and results in a program that is easier to un- 
derstand and debug. Often, a recursive approach can be implemented withfew lines ofcode 
when a corresponding iterative approach may take large amounts ofcode. Another reason 
to choose a recursive solution is that an iterative solutiori may not be apparent. 



Performance Tip 4.3 

Avoid using recursion in performance situations. Recursive calls take time and consume ad- 
ditional memory. 


Common Programming Error 4.8 



Accidentally having a function that solves a non-recursive algorithm call itself either direct- 
ly or indirectly (through another function), is a logic error. 


Let us reconsider some observations that we make repeatedly throughout the book. 
Good Software engineering is important. High performance is important. Unfortunately, 
these goals are often at odds with one another. Good Software engineering is key to 
making more manageable the task of developing the larger and more complex Software sys- 
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tems. High performance in these systems is key to realizing the systems of the future, which 
will place ever-greater computing demands on hardware. Where do functions fit in here? 



Functionalizing programs in a neat, hierarchical manner promotes good Software engi- 
neering, but it has a price. 



Performance Tip 4.4 

A heavily fimctionalizedprogram—as compared with a monolithic (i.e., one-piece)program 
withoutfunctions—makes potentially large numbers offunction calls, and these consume ex- 
ecution time and memory space on a computer'‘s processor(s). But monolithic programs are 
dijficult to program, test, debug and maintain. 


So functionalize programs judiciously, always keeping in mind the delicate balance 
between performance and good Software engineering. 


4.13 Defautt Arguments 

Function calls may commonly pass a particular value of an argument. When defining a 
function, the programmer can specify an argument as a default argument, and the program- 
mer can provide a default value for that argument. Default arguments are a convenience; 
they allow the programmer to specify fewer arguments when calling a function. When a 
default argument is omitted in a function call, the interpreter inserts the default value of that 
argument and passes the argument in the call. 

Default arguments must appear to the right of any non-default arguments in a func¬ 
tion’s parameter list. When calling a function with two or more default arguments, if an 
omitted argument is not the rightmost argument in the argument list, all arguments to the 
right of that argument also must be omitted. 

Figure 4.20 demonstrates using default arguments in calculating the volume of a box. 
The function definition for boxVolume in line 5 specifies that all three arguments have 
been given default values of 1. Note that default values should be defined only in the func¬ 
tion’s def statement. 


1 

# Fig. 4.20: fig04 20.py 


2 

# Using default arguments. 


3 

4 

# function definition with 

default arguments 

5 

def boxVolume ( length = , 

width = , height = ): 

6 

return length * width * 

height 

7 

8 

print "The default box vol: 

, boxVolume () 

9 

print "\nThe volume of a b( 


10 

print "width 1 and height : 

, boxVolume ( ) 

11 

print "\nThe volume of a b< 


12 

print "width 5 and height : 

, boxVolume ( , ) 

13 

print "\nThe volume of a b< 


14 

print "width 5 and height : 

, boxVolume ( , , ) 


Fig. 4.20 Default arguments (Part 1 of 2.) 
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The default box volume is: 1 

The volume of a box with length 10, 
width 1 and height 1 is: 10 

The volume of a box with length 10, 
width 5 and height 1 is: 50 

The volume of a box with length 10, 
width 5 and height 2 is: 100 


Fig. 4.20 Default arguments. (Part2of 2.) 




The first call to boxVolume (line 8) specifies no arguments and thus uses ali three 
default values. The second call (line 10) passes a length argument and thus uses default 
values for the width and height arguments. The third call (line 12) passes arguments for 
length and width and thus uses a default value for the height argument. The last call 
(line 14) passes arguments for length, width and height, thus using no default values. 



Good Programming Practice 4.6 

Using default arguments can simplify writing function calls. However, some programmers 
feel that explicitly specifying ali arguments makes programs easier to read. 



Common Programming Error 4.9 


Default arguments must be the rightmost (trailing) arguments. Omitting an argument other 
than a rightmost argument is a syntax error. 


4.14 Keyword Arguments 

The programmer can specify that a function receives one or more keyword arguments. The 
function definition assigns a default value to each keyword. A function may use a default 
value for a keyword or a function call may assign a new value to the keyword using the 
format keyword = value. When using keyword arguments, the position of arguments in 
the function call is not required to match the position of the corresponding parameters in 
the function definition. Figure4.21 demonstrates using keyword arguments in a Python 
program that displays information about a requested Web site. 


1 

# Fig. 4.21: fig04 21.py 




2 

# Keyword arguments example. 




3 





4 

def generateWebsite( name, uri = 


r 


5 

Flash = , CGI = ): 




6 

print "Generating site requested 

, name, 


, uri 

7 





8 

if Flash == : 




9 

print "Flash is enabled" 




10 












Fig.4.21 Keyword parametens. (Part 1 of 2.) 
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11 

if CGI == : 


12 

print CGI Scripts 


13 

14 

print # prints a new 

line 

15 

16 

generateWebsite( 

) 

17 

generateWebsite( 

, Flash 

18 

19 

uri = 

) 

20 

generateWebsite( CGI = 

, name 


) 


Generating site requested by Deitel using uri www.deitel.com 
CGI Scripts are enabled 

Generating site requested by Deitel using uri www.deitel.com/new 

Flash is enabled 

CGI Scripts are enabled 

Generating site requested by Prentice Hali using uri www.deitel.com 


Fig.4.21 Keywond parameters. (Part 2 of 2.) 

Function generateWebsite takes four arguments. The keyword argument names 
uri, Flash and CGI are assigned the default values "www.deitel.com", "no" and 
"yes ", respectively (lines 4-5). The function identifies who is requesting the Web site and 
displays a message if the Web site is Flash- or CGI-enabled (lines 6-13). 

The function call in line 15 passes one argument, a value for name, to function 
generateWebsite. The function uses the default values given in the definition for the 
other parameters. 

The function call in lines 17-18 passes three arguments to generateWebsite. 
Variable name again has the value "Deitel". The call also assigns the value "yes" to 
keyword argument Flash and "www. deitel .com/new" to keyword argument uri. 
This function call illustrates that the order of keyword arguments is more flexible than that 
of regular arguments in an ordinary function call. The Python interpreter matches the value 
"Deitel " with variable name by its position in the function call. The Python interpreter 
matches the values passed to uri and Flash by their keyword argument names rather 
than by their positions in the function call. The value of name must come first in any call 
to generateWebsite if it is not referenced by specifying a value for name in the argu¬ 
ment list. Line 20 demonstrates that any function argument can be referenced as a keyword 
even if it has no default value. 

The interactive session of Fig. 4.22 demonstrates common errors when mixing non- 
keyword and keyword arguments. Function call test( numberl = "two", "Name" ) 
causes an error, because the non-keyword argument is placed after the keyword argument. 
Function call test ( numberl = "three" ) is incorrect, because function test expects 
one non-keyword argument. 

Common Programming Error 4.10 


Misplacing or omitting the value for a non-keyword argument in a function call is an error. 
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Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 
win32 

Type "help", "Copyright", "credits" or "license" for more Informa¬ 
tion. 

>>> def test( name, numberl = "one", number2 = "two" ): 
pass 

>>> test( numberl = "two", "Name" ) 

SyntaxError: non-keyword arg after keyword arg 
>>> test( numberl = "three" ) 

Traceback (most recent call last): 

File "<stdin>", line 1, in ? 

TypeError: test() takes at least 1 non-keyword argument (0 given) 


Fig. 4.22 Erronswith keyword arguments. 


SUMMARY 


Constructing a large program from smaller components, each of which is more manageable than 
the original program, is a technique called divide and conquer. 

Components in Python are called functions, classes, modules and packages. 


Python programs typically are written by combining new functions and classes the programmer 
writes with “pre-packaged” functions or classes available in numerous Python modules. 


The programmer can write programmer-defined functions to define specific tasks that could be 
used at many points in a program. 


A module defines related classes, functions and data. A package groups related modules. The 
package as a whole provides tools to help the programmer accomplish a general task. 


A function is invoked (i.e., made to perform its designated task) by a function call. 


The function call specifies the function name and provides information (as a comma-separated list 
of arguments) that the called function needs to do its job. 


Ali variables created in function definitions are local variables—they are known only in the func¬ 
tion in which they are created. 


Most functions have a list of parameters that provide the means for communicating information 
between functions. A function’s parameters are also local variables. 


The divide-and-conquer approach makes program development more manageable. 

Another motivation for using the divide-and-conquer approach is Software reusability—using ex- 
isting functions as building blocks to create new programs. 

A third motivation for using the divide-and-conquer approach is to avoid repeating code in a pro¬ 
gram. Packaging code as a function allows the code to be executed from several locations in a pro¬ 
gram simply by calling the function. 

The math module functions allow the programmer to perform certain common mathematical cal- 
culations. 


Functions normally are called by writing the name of the function, followed by a left parenthesis, 
followed by the argument (or a comma-separated list of arguments) of the function, followed by a 
right parenthesis. 

To use a function that is defined in a module, a program has to import the module, using keyword 
import. After the module has been imported, the program can access a function or a variable in 
the module, using the module name, a dot (.) and the function or variable name. 
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• Functions are defined with keyword def. 

• The indented statements that follow a def statement form the function body. The function body 
also is referred to as a block. 

• There are three ways to return control to the point at which a function was invoked. If the function 
does not return a resuit, control is retumed simply when the last indented line is reached, or upon 
executing return. If the function does return a resuit, the statement return expression re- 
tums the value of expression to the caller. 

• None is a Python value that represents null— indicating that no value has been declared—and that 
evaluates to false in conditional expressions. 

• The element of chance can be introduced into computer applications using module random. 

• Function randrange generates an integer in the range of its first argument to, but not including, 
its second argument. If randrange truly produces integers at random, every number between 
the first argument and the second argument has an equal chance (or probability) of being chosen 
each time the function is called. 

• Python has striet rules that describe how and when a variable’s value can be accessed. These rules 
are described in terms of namespaces and scopes. 

• Namespaces store information about an identifier and the value to which it is bound. 

• Python defines three namespaces; when a program attempts to access an identifier’ s value, Python 
searches the namespaces in a specific order to see whether and where the identifier exists. 

• The local namespace Stores bindings created in a block. Ali function parameters and any identifiers 
the function creates are stored in the function’s local namespace. 

• The global (or module) namespace contains the bindings for ali identifiers, function names and 
class names defined in a file or module. 

• Each module's global namespace contains an identifier called_ name _that provides the name 

for that module. When a Python interpreter session is started or when the Python interpreter is in¬ 
voked on a program stored in a file, the value of_ name _is " main_ " . 

• The built-in namespace contains identifiers that correspond to rnany Python functions and errors. 
Python creates the built-in namespace when the interpreter starts, and programs normally do not 
modify the namespace (e.g., by adding an identifier to the namespace). 

• An identifier’s scope describes the region of a program that can access the identifier’s value. 

• If an identifier is defined in the local namespace (e.g., of a function), that identifier has local scope. 
Once the code block terminates (e.g., when a function returns), ali identifiers in that block’s local 
namespace “go out of scope” and no longer can be accessed. 

• If an identifier is defined in the global namespace, the identifier has global scope. A global iden¬ 
tifier is known to ali code that exeeutes within that module, from the point at which the identifier 
is created until the end of the file. 

• When a function creates a local identifier with the same name as an identifier in the module or 
built-in namespaces, the local identifier is said to shadow the global or built-in identifier. The pro- 
grammer can introduce a logic error into the program if the programmer refers to the local variable, 
but intends to refer to the global or built-in identifier. 

• A recursive function is a function that calls itself, either directly or indirectly. 

• A recursive function actually knows how to solve only the simplest case(s) or so-called base 
case(s) of a problem. 

• If a recursive function is not called with a base case, the function divides the problem into two con- 
ceptual pieces: A piece that the function knows how to do (base case), and apiece that the function 
does not know how to do. 
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• A recursive function invokes a fresh copy of itself to go to work on a smaller version of the prob- 
lem; this procedure is referred to as a recursive call and is also called the recursion step. 

• Both iteration and recursion are based on a control structure: Iteration uses a repetition structure; 
recursion uses a selection structure. 

• Both iteration and recursion also involve repetition: Iteration explicitly uses a repetition structure; 
recursion achieves repetition through repeated function calls. 

• Iteration and recursion both involve a termination test: Iteration terminates when the loop-contin- 
uation condition fails; recursion terminates when a base case is recognized. 

• Iteration with counter-controlled repetition and recursion both gradually approach termination: It¬ 
eration keeps modifying a counter until the counter assumes a value that makes the loop-continu- 
ation condition fail; recursion keeps producing simpler versions of the original problem until the 
base case is reached. 

• Iteration and recursion can both occur infinitely: An infinite loop occurs with iteration if the loop- 
continuation test never becomes false; infinite recursion occurs if the recursion step does not re¬ 
duce the problem each time in a manner that converges on the base case. 

• Recursion repeatedly invokes the mechanism and, consequently, the overhead of function calls. 
This can be expensive in both processor time and memory space. Iteration normally occurs within 
a function, so the overhead of repeated function calls and extra memory assignment is omitted. 

• Some function calls commonly pass a particular value of an argument. The programmer can spec- 
ify that such an argument is a default argument, and the programmer can provide a default value 
for that argument. When a default argument is omitted in a function call, the interpreter automat- 
ically inserts the default value of that argument and passes the argument in the call. 

• Default arguments must be the rightmost (trailing) arguments in a function’s parameter list. When 
calling a function with two or more default arguments, if an omitted argument is not the rightmost 
argument in the argument list, ali arguments to the right of that argument also must be omitted. 

• The programmer can specify that a function receives one or more keyword arguments. The func¬ 
tion definition can assign a value to a keyword argument. Either a function may a default value for 
a keyword argument or a function call may assign a new value to the keyword argument, using the 
format keyword = value. 


TERMINOLOGY 


acos function 
a sin function 
at an function 
base case 


fabs function 
factorial 
Fibonacci series 
f loor function 
fmod function 
function 

function argument 
function body 
function call 
function definition 
function name 
function parameter 
global keyword 
global namespace 
global variable 
globals function 
hypot function 


built-in namespace 


_builtins 

calling function 
ceil function 


comma-separated list of arguments 


cos function 
def statement 


default argument 


dir function 


divide and conquer 


dot (.) operator 
exp function 
expression 
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identifier 
import keyword 
iterative function 
keyword argument 
local namespace 
local variable 
locals function 
log function 
loglO function 

"_main_" 

main program 
math module 
module 

module namespace 


_nante_ 

package 
parameter list 
probabili ty 
random module 
randrange function 
recursion 
recursive function 
return keyword 
scope 

s in function 
sqrt function 
tan function 


SELF-REVIEW EXERCISES 

4.1 Fili in the blanks in each of the following statements. 

a) Constructing a large program from smaller components is called_. 

b) Components in Python are called _, _, _ and 


c) “Pre-packaged” functions or classes are available in Python_. 

d) The_module functions allow programmers to perform common mathemati- 

cal calculations. 

e) The indented statements that follow a_statement form a function body. 

f) The_in a function call is the operator that causes the function to be called. 

g) The_module introduces the element of chance into Python programs. 

h) A program can obtain the nante of its module through identifier_. 

i) During code execution, three namespaces can be accessed:_,_and 


j) A recursive function converges on the_. 

4.2 State whether each of the following is true or false. If false, explain why. 

a) Ali variables declared in a function are global to the program containing the function. 

b) An import statement must be included for every module function used in a program. 

c) Function fmod returns the floating-point remainder of its two arguments. 

d) The keyword return displays the resuit of a function. 

e) A function’s parameter list is a comma-separated list containing the names of the param- 
eters received by the function when it is called. 

f) Function call random. randrange (1,7) produces a random integer in the range 
1 to 7, inclusive. 

g) An identifier’s scope is the portion of the program in which the identifier has meaning. 

h) Every call to a recursive function is a recursive call. 

i) Omitting the base case in a recursive function can lead to “infinite” recursion. 

j) A recursive function may call itself indirectly. 

ANSWERS TO SELF-REVIEW EXERCISES 

4.1 a) divide and conquer. b) functions, classes, modules, packages. c) modules. d)math. 

e) def. f) pair of parentheses, g) random. h)_ name_ . i) the local namespace, the global 

namespace, the built-in namespace. j) base case. 
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4.2 a) False. Ali variables declared in a function are local—known only in the function in which 

they are defined. b) False. Functions included in the _ builtin _module do not need to be im- 

ported. c) True. d) False. Keyword return passes control and optionally, the value of an expression, 
back to the point from which the function was called. e) True. f) False. Function call random.ran- 
drange (1,7) produces a random integer in the range from 1 to 6, inclusive. g) True. h) False. 
The initial call to the recursive function is not recursive. i) True. j) True. 






EXERCISES 

4.3 Implement the following function fahrenheit to return the Fahrenheit equivalent of a 
Celsius temperature. 

9 

F = 2 c + 32 

Use this function to write a program that prints a chart showing the Fahrenheit equivalents of ali Cel¬ 
sius temperatures 0-100 degrees. Use one position of precision to the right of the decimal point for 
the results. Print the outputs in a neat tabular format that minimizes the number of lines of output 
while remaining readable. 

4.4 An integer greater than 1 is said to be prime if it is divisible by only 1 and itself. For example, 
2, 3, 5 and 7 are prime numbers, but 4, 6, 8 and 9 are not. 

a) Write a function that determines whether a number is prime. 

b) Use this function in a program that determines and prints ali the prime numbers between 
2 and 1,000. 

c) Initially, you might think that n/2 is the upper limit for which you must test to see whether 
a number is prime, but you need go only as high as the square root of n. Rewrite the pro¬ 
gram and run it both ways to show that you get the same resuit. 

4.5 An integer number is said to be a perfect number if the sum of its factors, including 1 (but 
not the number itself), is equal to the number. For example, 6 is a perfect number, because 6=1+2 
+ 3. Write a function perfect that determines whether parameter number is a perfect number. Use 
this function in a program that determines and prints all the perfect numbers between 1 and 1000. 
Print the factors of each perfect number to confirm that the number is indeed perfect. Challenge the 
power of your computer by testing numbers much larger than 1000. 

4.6 Computers are playing an increasing role in education. The use of computers in education is 
referred to as computer-assisted instructiori (CAI). Write a program that will help an elementary 
school student learn multiplication. Use the random module to produce two positive one-digit inte- 
gers. The program should then display a question, such as 

How much is 6 times 7? 

The student then types the answer. Next, the program checks the student’ s answer. If it is correct, print 
the string "Very good! " on the screen and ask another multiplication question. If the answer is 
wrong, display M No. Please try again. " and let the student try the same question again repeat- 
edly until the student finally gets it right. A separate function should be used to generate each new 
question. This method should be called once when the program begins execution and each time the 
user answers the question correctly. (Hinf. To convert the numbers for the problem into strings for 
the question, use function str. For example, str ( 7 ) returns "7“.) 

4.7 Write a program that plays the game of “guess the number” as follows: Your program choos- 
es the number to be guessed by selecting an integer at random in the range 1 to 1000. The program 
then displays 
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I have a number between 1 and 1000. 

Can you guess my number? 

Please type your first guess. 

The player then types a first guess. The program responds with one of the following: 

1. Excellent! You guessed the number! 

Would you like to play again (y or n)? 

2. Too low. Try again. 

3. Too high. Try again. 

If the player's guess is incorrect, your program should loop until the player finally gets the number 
right. Your program should keep telling the player Too high or Too low to help the player “zero 
in” on the correct answer. After a game ends, the program should prompt the user to enter "y" to play 
again or "n" to exit the game. 

4.8 (Towers ofHanoi) Every budding computer scientist must grapple with certain classic prob- 

lems. The Towers of Hanoi (see Fig. 4.23) is one of the most famous of these. Legend has it that, in 
a temple in the Far East, priests are attempting to move a stack of disks from one peg to another. The 
initial stack had 64 disks threaded onto one peg and arranged from bottom to top by decreasing size. 
The priests are attempting to move the stack from this peg to a second peg, under the constraints that 
exactly one disk is moved at a time and that at no time may a larger disk be placed above a smaller 
disk. A third peg is available for holding disks temporarily. Supposedly, the world will end when the 
priests complete their task, so there is little incentive for us to facilitate their efforts. 

Let us assume that the priests are attempting to move the disks from peg 1 to peg 3. We wish to 
develop an algorithm that will print the precise sequence of peg-to-peg disk transfers. 

If we were to approach this problem with conventional methods, we would rapidly find our- 
selves hopelessly knotted up in managing the disks. Instead, if we attack the problem with recursion 
in mind, it immediately becomes tractable. Moving n disks can be viewed in terms of moving only n 
- 1 disks (hence, the recursion), as follows: 

a) Move n - 1 disks from peg 1 to peg 2, using peg 3 as a temporary holding area. 

b) Move the last disk (the largest) from peg 1 to peg 3. 

c) Move the n - 1 disks from peg 2 to peg 3, using peg 1 as a temporary holding area. 

The process ends when the last task involves moving n = 1 disk, i.e., the base case. This is 

accomplished trivially by moving the disk without the need for a temporary holding area. 

Write a program to solve the Towers of Hanoi problem. Use a recursive function with four 
parameters: 

a) The number of disks to be moved 

b) The peg on which these disks are initially threaded 

c) The peg to which this stack of disks is to be moved 

d) The peg to be used as a temporary holding area 

Your program should print the precise instructions it will take to move the disks from the start- 
ing peg to the destination peg. For example, to move a stack of three disks from peg 1 to peg 3, your 
program should print the following series of moves: 

1 —> 3 (This means move one disk from peg 1 to peg 3.) 

I —> 2 

3 —> 2 

1 3 

2 -> 1 
2—> 3 
1—> 3 
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Fig. 4.23 The Towersof Hanoi forthe case with 4disks. 
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Objectives 

• To understand Python sequences. 

• To introduce the list, tuple and dictionary data types. 

• To understand how to create, initialize and refer to 
individual elements of lists, tuples and dictionaries. 

• To understand the use of lists to sort and search 
sequences of values. 

• To be able to pass lists to functions. 

• To introduce list and dictionary methods. 

• To create and manipulate multiple-subscript lists and 
tuples. 

With sobs and tears he sorted out 
Those ofthe largest size ... 

Lewis Carroll 

Attempt the end, and never stand to doubt; 

Nothing’s so hard, but search willfind it out. 

Robert Herrick 

Now go, write it before them in a table, 
and note it in a book. 

Isaiah 30:8 

‘Tis in my memory lock’d. 

And you yourself shall keep the key of it. 

William Shakespeare 
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Outline 

5.1 Introduction 

5.2 Sequences 

5.3 Creating Sequences 

5.4 Using Lisband Tuples 

5.4.1 Using Lists 

5.4.2 Using Tuples 

5.4.3 Sequence Unpacking 

5.4.4 Sequence Slicing 

5.5 Dictionaries 

5.6 List and Dictio na ry Methods 

5.7 =References and Re fe rene e Para mete is 

5.8 Passing Lists to Functions 

5.9 Sorting and Seaiching Lists 

5.10 Multiple-Subscripted Sequences 

Summary • Terminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 


5.1 Introduction 


(tt) 


This chapter introduces Python’s data-handling capabilities that use data structures. Data 
structures hold and organize information (data). Many types of data structures exist, and 
each type has features appropriate for certain tasks. Sequences, often called arrays in other 
languages, are data structures that store (usually) related data items. Python supports three 
basic sequence data types: the string, the list and the tuple. Mappings, often called associa- 
tive arrays or hashes in other languages, are data structures that store data in key-value 
pairs. Python supports one mapping data type: the dictionary. This chapter discusses Py¬ 
thoni sequence and mapping types in the context of several examples. Chapter 22, Data 
Structures, introduces some high-level data structures ( linked lists, queues, stacks and 
trees) that extend Python’s basic data types. 


5.2 Sequences 

A sequence is a series of contiguous values that often are related. We already have encoun- 
tered sequences in several programs: Python strings are sequences, as is the value returned 
by function range —a Python built-in function that returns a list of integers. In this sec- 
tion, we discuss sequences in detail and explain how to refer to a particular element, or lo- 
cation, in the sequence. 

Figure5.1 illustrates sequence c, which contains 12 integer elements. Any element 
may be referenced by writing the sequence name followed by the element’s position 
number in square brackets ([ ]). The first element in every sequence is the zerotli element. 
Thus, in sequence c, the first element is c [ 0 ], the second element is c [ 1 ] , the sixth 
element of sequence c is c [ 5 ] . In general, the ith element of sequence c is c [ i - 1 ] . 
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Name ofsequence (c) 

1 


c [ 0 ] 

-45 

c [ -12 ] 

c [ 1 ] 

6 

c [ -11 ] 

c [ 2 ] 

0 

c [ -10 ] 

c [ 3 ] 

72 

c [ -9 ] 

c [ 4 ] 

1543 

c [ -8 ] 

c [ 5 ] 

-89 

c [ -7 ] 

c [ 6 ] 

0 

c [ -6 ] 

c [ 7 ] 

62 

c [ -5 ] 

c [ 8 ] 

-3 

c [ -4 ] 

c [ 9 ] 

1 

c [ -3 ] 

c[ 10 ] 

6453 

c [ -2 ] 

c[ 11 ] 

78 

c [ -1 ] 


Position numberofthe 
element within sequence c 


Fig. 5.1 Sequence with elementsand indices. 

Sequences also can be accessed from the end. The last element is c [ -1 ], the second to 
last element is c [ - 2 ] and the /th-from-the-end is c [ - i ]. Sequences follow the same 
naming conventions as variables. 

The position number more formally is called a subscript (or an index), which must be 
an integer or an integer expression. If a program uses an integer expression as a subscript, 
Python evaluates the expression to determine the index. For example, if variable a equals 
5 and variable b equals 6, then the statement 

print c[ a + b ] 

prints the value of c [ 11 ]. Integer expressions used as subscripts can be useful for iterat- 
ing over a sequence in a loop. 

Python lists and dictionaries are mutable —they can be altered. For example, if 
sequence c in Fig. 5.1 were mutable, the statement 

c [ ] = 


modifies the value of element 11 by assinging it a new value of 0 to replace the original 
value of 7 8. 
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On the other hand, some types of sequences are immutable —they cannot be altered 
(e.g., by changing element values). Python strings and tuples are immutable sequences. For 
example, if the sequence c were immutable, the statement 

c [ ] = 

would be illegal. Let us examine sequence c in detail. The sequence na me is c. The length 
of the sequence is determined by the function call len ( c ). It is useful to know a se¬ 
quence’s length, because referring to an element outside the sequence results in an “out-of- 
range” error. Most of the errors discussed in this chapter can be caught as exceptions. [Note: 
We discuss exceptions in Chapter 12, Exception Handling.] 

Sequence c contains 12 elements, namely c [ 0 ] , c [ 1 ] , ..., c [ 11 ] . The range of 
elements also can be referenced by c [ -12 ], c [ -11 ], ..., c [ -1 ]. In this example, 
c [ 0 ] contains the value -4 5, c [ 1 ] contains the value 6, c [ - 9 ] contains the value 
72 and c [ -2 ] contains the value 6453. To calculate the sum of the values contained in 
the first three elements of sequence c and assign the resuit to variable sum, we would write 

sum =c[ ]+c[ ]+c[ ] 

To divide the value of the seventh element of sequence c by 2 and assign the resuit to the 
variable x, we would write 



x = c [ ] / 

Common Programming Error 5.1 


It is important to note the dijference between the “seventh element ofthe sequence ” and “se¬ 
quence element seven. ” Sequence subscripts begin at 0, thus the “seventh element ofthe se¬ 
quence” has a subscript of 6. On the other hand, “sequence element seven" references 
subscript 7 (i.e., c [ 7 ] ), whicli is the eighth element ofthe sequence. This confusiori often 
leads to “off-by-one ” errors. 



Testing and Debugging Tip 5.1 

In other programming languages that do not allow negative subscripts, if a negative sub¬ 
script is accidentally calculated, a run-time error occurs. In Python, such an Occidental neg¬ 
ative subscript could cause a non-fatal logic error, with the program running to completion 
and producing invalid results. 


The pair of square brackets enclosing the subscript of a sequence is a Python operator. 
Figure 5.2 shows the precedence and associativity of the operators introduced to this point 
in the text. They are shown from top to bottom in decreasing order of precedence, with their 
associativity and types. 


5.3 Creating Sequences 

Different Python sequences (strings, lists and tuples) require different syntax. We illustrat- 
ed how Python strings are created by placing the text of the string within quotes. To create 
an empty string, use a statement like 

aString = 

Note that we could have used single quotes ( 1 ) or triple quotes (" 11 " or 1 ") to create the 
string. 
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Operatois 

Assoc iativity 

Type 

0 

left to right 

parentheses 

[] 

left to right 

subscript 

. 

left to right 

member access 

* * 

right to left 

exponentiation 

* / // % 

left to right 

multiplicative 

+ 

left to right 

additive 

A 

A 

II 

V 

V 

II 

left to right 

relational 

== != <> 

left to right 

equality 


Fig.5.2 Precedence and associativity of the operatorsdiscussed so far. 


To create an empty list, use a statement like 

aList = [] 

To create a list that contains a sequence of values, separate the values by commas inside 
square brackets ([ ]) 

aList = [ , , ] 

To create an empty tuple, use the statement 

aTuple = () 

To create a tuple that contains a sequence of values, simply separate the values with com¬ 
mas. 

aTuple = , , 

Creating a tuple is sometimes referred to as packing a tuple. Tuples also can be created by 
surrounding the comma-separated list of tuple values with optional parentheses. It is the 
commas that create tuples, not the parentheses. 

aTuple = ( ) 

When creating a one-element tuple—called a singleton — use a statement like 

aSingleton = , 

Notice that a comma (,) follows the value. The comma identifies the variable— 
aSingleton —as a tuple. If the comma were omitted, aSingleton would simply con- 
tain the integer value 1. 

5.4 llsing Lists and Tuples 

Lists and tuples both contain sequences of values. For example, a list or a tuple may contain 
the sequence of integers from 1 to 5 
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aList =[,,,, ] 

aTuple =(,,,, ) 

In practice, however, Python programmers distinguish between the two data types to rep- 
resent different kinds of sequences, based on the context of the program. In the next sub- 
sections, we discuss the situations for which lists and tuples are best suited. 

5.4.1 Using Lists 

Although lists are not restricted to homogeneous data types (i.e., values of the same data 
type), Python programmers typically use lists to store sequences of homogeneous values. 
For example, either a list may store a sequence of integers that represent test scores or a 
sequence of strings representing employee names. In general, a program uses a list to store 
homogeneous values for the purpose of looping over these values and performing the same 
operation on each value. Usually, the length of the list is not predetermined and may vary 
over the course of the program. The program in Fig. 5.3 demonstrates how to create, aug- 
ment and retrieve values from a list. 







1 

# Fig. 5 

.3: fig05 03.py 


2 

# Creating, accessing and changing a list. 


3 




4 

aList = 

[] 


5 




6 

# add values to list 


7 

for number in range( , ): 


8 

aList 

+= [ number ] 


9 




10 

print "T1 

, aList 


11 




12 

# access 

list values by iteration 


13 

print 



14 




15 

for item 

in aList: 


16 

print 

item. 


17 




18 

print 



19 




20 

# access 

list values by index 


21 

print 



22 

print "S\ 



23 




24 

for i in 

range( len( aList ) ): 


25 

print 

% ( i, aList! i ] ) 


26 




27 

# modify 

list 


28 

print 



29 

print "V; 


, aList 

30 

aList [ 

1 = 


31 

aList [ 

1 = 


32 

print "V; 


, aList 


Fig. 5.3 List of homogeneous values. (Part 1 of 2.) 
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The value 

of aList is: [1, 2, 3, 4, 5, 6, 7, 

8, 9, 10] 


Accessing 

values by iteration: 



1 2 3 4 5 

6 7 8 9 10 



Accessing 

values by index: 



Subscript 

Value 



0 

1 



1 

2 



2 

3 



3 

4 



4 

5 



5 

6 



6 

7 



7 

8 



8 

9 



9 

10 



Modifying 

a list value... 



Value of aList before modification: [1, 2, 3 

, 4, 5, 6, 7, 8, 9, 

10] 

Value of aList after modification: [-100, 2, 

3, 4, 5, 6, 7, 19, 

9, 10] 


Fig.5.3 Listof homogeneous values. (Part 2 of 2.) 

Line 4 creates empty list, aList. Lines 7-8 use a for loop to insert the values 1, 

10 into aList, using the += augmented assignment statement. When the value to the left 
of the += statement is a sequence, the value to the right of the statement also must be a 
sequence. Thus, line 8 places square brackets around the value to be added to the list. Line 
10 prints variable aList. Python displays the list as a comma-separated sequence of 
values inside square brackets. Variable aList represents a typical Python list—a 
sequence containing homogeneous data. 

Lines 13-18 demonstrate the most common way of accessing a list’s elements. The 
for structure actually iterates over a sequence 


for item in aList: 


The for structure (lines 15-16) starts with the first element in the sequence, assigns the 
value of the first element to the control variable (item) and executes the body of the for 
loop (i.e., prints the value of the control variable). The loop then proceeds to the next ele¬ 
ment in the sequence and performs the same operations. Thus, lines 15-16 print each ele¬ 
ment of aList. 

List elements also can be accessed through their corresponding indices. Lines 21-25 
access each element in aList in this manner. The function call in line 24 


range( len( aList ) ) 

returns a sequence that contains the values 0, .... len ( aList ) - 1. This sequence con- 
tains all possible element positions for aList. The for loop iterates through this se¬ 
quence and, for each element position, prints the position and the value stored at that 
position. 


































pythonhtpl_05.fm Page 162 Saturday, December 8, 2001 9:35 AM 





162 Lists, Tuples and Dictionaries 


Chapter 5 


Lines 30-31 modify some of the list’s elements. To modify the value of a particular 
element, we assign a new value to that element. Line 30 changes the value of the list’ s first 
element from 0 to -100; line 31 changes the value of the list’ s third-from-the-end element 
from 8 to 19. 

If the program attempts to access a nonexistent index (e.g., index 13) in aList, the 
program exits and Python displays an out-of-range error message. The interactive session 
in Fig. 5.4 demonstrates the results of accessing an out-of-range list element. 


Common Programming Error 5.2 



Referring to an element outside the sequence is an error. 





Testing and Debugging Tip 5.2 


When looping through a sequence. the positive sequence subscript should be less than the 
total number of elements in the sequence (i.e., the subscript should not be larger than the 
length of the sequence); whereas, the negative sequence subscript should be equal to or 
greater than the negation of the total number of elements in the sequence. Make sure the 
loop-terminating condition prevents accessing elements outside this range. 


Generally, a program does not concern itself with the length of a list, but simply iter- 
ates over the list and performs an operation for each element in the list. Figure 5.5 demon¬ 
strates one practical application of using lists in such a manner—creating a histogram (a 
bar graph of frequencies) from a collection of data. 


Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 
win32 

Type "help", "Copyright", "credits" or "license" for more Informa¬ 
tion. 

>>> aList = [ 1 ] 

>>> print aList [ 13 ] 

Traceback (most recent call last): 

File "<stdin>", line 1, in ? 

IndexError: list index out of range 


Fig. 5.4 Out-of-range emor. 


1 # Fig. 5.5: fig05 05.py 

2 # Creating a histogram from a list of values. 

3 

4 values = [] 

5 

6 # input 10 values from user 

7 print Enter 10 integers :" 

8 

9 for i in range( ): 

10 newValue = int( raw_input( % ( i + ) ) ) 

11 values += [ newValue ] 

12 








Fig.5.5 Histogram created from a list of values. (Part 1 of 2.) 
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13 

14 

# create 
print "\i 

histogram 


15 

16 

print 

% ( 

) 

17 

for i in 

range( len( values ) ): 


18 

print 

% ( i, values[ i ] , 

* values[ i 


Enter 

10 integers: 

Enter 

integer 

1: 

19 

Enter 

integer 

2: 

3 

Enter 

integer 

3: 

15 

Enter 

integer 

4: 

7 

Enter 

integer 

5: 

11 

Enter 

integer 

6: 

9 

Enter 

integer 

7: 

13 

Enter 

integer 

8: 

5 

Enter 

integer 

9: 

17 

Enter 

integer 

10 

: 1 

Creating a histogram from values: 

Element Value Histogram 


0 


19 ******************* 


1 


3 * * * 


2 


15 *************** 


3 


7 ******* 


4 


11 *********** 


5 


9 ********* 


6 


13 ************* 


7 


5 ***** 


8 


17 ***************** 


9 


1 * 


Fig.5.5 Histogram created fnom a listof values. (Part2 of 2.) 



The program creates an empty list called values (line 4). Lines 7-11 input 10 inte- 
gers from the user and insert those integers into the list. Lines 14-18 create the histogram. 
For each element in the list, the program prints the element’s index and value and a string 
that contains the same number of asterisks (*) as the value. The expression 

* values[ i ] 

uses the multiplication operator (*) to create a string with the number of asterisks specified 

by values [ i ] . 


5.4.2 Using lupies 

Whereas lists typically store sequences of homogeneous data, tuples typically store se- 
quences of heterogeneous data—this is a convention, not a rule, that Python programmers 
follow. Each data item in a tuple provides a part of the total information represented by the 
tuple. For example, a tuple can represent a student in a class. The tuple could contain the 
student’ s name (represented as a string) and age (represented as an integer). Or, a tuple can 
represent the time of day, using three parts—the hour, minute and second. Although all 
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these values might be represented as integers, each integer has its own meaning, and the 
full representation of the time is obtained only by taking all three values together. The 
length of the tuple (i.e., its number of data items) is predetermined and cannot change dur- 
ing a program’s execution. 

By convention, each data item in the tuple represents a unique portion of the overall 
data. Therefore, a program usually does not iterate over a tuple, but accesses the parts of 
the tuple the program needs to perform its task. Figure 5.6 demonstrates how to create and 
access a tuple using this idiom. 

Lines 5-7 ask the user to enter three integers that represent the hour, minutes and sec- 
onds, respectively. Line 9 creates a tuple called currentTime to store the user-entered 
values. Lines 14—16 print the number of seconds that have passed since midnight. We per¬ 
form a different operation (i.e., multiply each value by a different factor) for each value in 
the tuple; therefore, the program accesses each value by its index. 

As tuples are immutable, Python provides error handling that notifies users when they 
attempt to modify tuples. For example, if the program attempts to change the first element 
in currentTime to contain the value 0, 


currentTime[ ] = 

the program exits and Python displays a runtime error 


Traceback (most recent call last): 
File "fig05_06.py", line 18, in 
currentTime[ 0 ] = 0 
TypeError: object doesn't support 


■p 


item assignment 


(«) 


to indicate that the program illegally attempted to change the value of the immutable tuple. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 


# Fig. 5.6: fig05_06.py 

# Creating and accessing tu] 

# retrieve hour, minute and 

hour = int( raw_input( 
minute = int( raw_input( 
second = int( raw_input( 

currentTime = hour, minute, 

print "The value 

# access tuple 

print "The number of seconds 
( currentTime[ ] * 

currentTime[ ] ) 


les. 

second from user 
) ) 

) ) 

) ) 

second # c 

, currentTime 


since midnight is", \ 

+ currentTime[ ] * + 









Fig. 5.6 Tuplescreated and accessed. 
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Note that the use of lists and tuples introduced in Section 5.4.1 and Section 5.4.2 is not 
a rule, but rather a convention that Python programmers follow. Python does not limit the 
data type stored in lists and tuples (i.e., they can contain homogeneous or heterogeneous 
data). The primary difference between lists and tuples is that lists are mutable whereas 
tuples are immutable. 

5.4.3 Sequence Unpacking 

Recall that creating a tuple with 
aTuple = , , 


or 


aTuple = ( 


) 




is called packing a tuple, because the values are “packed into” the tuple. Tuples and other 
sequences also can be unpacked —the values stored in the sequence are assigned to various 
identifiers. Unpacking is a useful programming shortcut for assigning values to multiple 
variables in a single statement. The program in Fig. 5.7 demonstrates the results of unpack¬ 
ing strings, lists and tuples. 

Lines 5-7 create a string, a list and a tuple, each containing three elements. Sequences 
are unpacked with an assignment statement. The assignment statement in line 11 unpacks the 
elements in variable aString and assigns each element to a variable. The first element is 
assigned to variable first, the secondto variable second and the thirdto variable third. 
Line 12 prints the variables to confirm that the string unpacked properly. Lines 14—20 per- 
form similar operations for the elements in variables aList and aTuple. When unpacking 
a sequence, the number of variable names to the left of the = Symbol should equal the number 
of elements in the sequence to the right of the Symbol; otherwise, a runtime error occurs. 
Notice that when unpacking a sequence, parentheses or brackets are optional to the left of the 
= Symbol because there usually are no precedence issues. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 
17 


# Fig. 5.7: fig05_07.py 

# Unpacking sequences. 

# create sequences 

aString = 

aList = [ , , ] 

aTuple = , , 

# unpack sequences to variables 

print "Unpacking string..." 

first, second, third = aString 

print , first, second, third 

print " \nUnpacking list..." 

first, second, third = aList 

print , first, second, third 






Fig. 5.7 Unpacking strings, listsand tuples. (Part 1 of 2.) 
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18 

print " 



19 

first, second. 

third = 

aTuple 

20 

print "Tupl 

r 

first, second, third 

21 




22 

# swapping two 

values 


23 

x = 



24 

y = 



25 




26 

print "\nBe 


% ( x, y ) 

27 

x , y = y, x 

# swap 

variables 

28 

print "After s\ 


% ( x, y ) 



Lines 22-28 demonstrate one benefit of sequence packing and unpacking—swapping 
the value of two variables. Lines 23-24 create two variables x and y, with the values 3 and 
4, respectively. Line 27 


x » y = y» x 

swaps the values assigned to each variable. Python swaps the value by first packing the 
right-hand side of the statement into a tuple (e.g., (4,3)), then unpacking that tuple to 
variables x and y, respectively. Thus, the value assigned to variable x is now assigned to 
variable y, and the value assigned to variable y is now assigned to variable x. 


5.4.4 Sequence Slicing 

We have discussed how to create sequences and access them through the [] operator (to 
access one element) or a for statement (to access all the elements iteratively). Sometimes, 
a program may need to access a series of sequential values (e.g., the characters of a person’s 
last name in a string that Stores the person’s full name). For these cases, Python allows pro- 
grams to slice a sequence. 

Figure 5.8 demonstrates Python sequence-slicing capabilities. The program creates three 
sequences—a string, a tuple and a list. The program prompts the user to enter a starting and 
ending index, creates the specified slice for each sequence and prints the slice to the screen. 


1 # Fig. 5.8: fig05 08.py 

2 # Slicing sequences. 

3 








Fig.5.8 Sequence slices. (Partiof 3.) 
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4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 


# create sequences 

sliceString = 

sliceTuple ) 

sliceList = [ , , , , , 


# print strings 

print "sliceStr 

print 

print 

print 


, sliceString 
, sliceTuple 
, sliceList 


# get slices 

start = int( raw_input( ) ) 

end = int( rawinput( ) ) 

# print slices 

print , start, , end, 

sliceString[ start:end ] 


\ 


print , start, , end, , \ 

sliceTuple[ start:end ] 

print , start, , end, , \ 

sliceList [ start:end ] 


sliceString: abcdefghij 

sliceTuple: (1, 2, 3, 4, 5, 6, 7, 8, 9, 10) 

sliceList: ['I', 'II', 'III', 'IV', 'V', 'VI', 'VII', 'VIII', 

'IX', 'X'] 

Enter start: 3 
Enter end: 3 

sliceString[ 3:3]= 
sliceTuple [ 3:3]= () 

sliceList[3:3]= [] 


sliceString: abcdefghij 





sliceTuple: (1, 

2, 3, 4 

, 5, 6, 

00 

[> 

9, 

10) 

sliceList: ['I' 

, 'II', 

1 III 1 , 

IV' , 

V' 

, 'VI', 'VII', 'VIII', 

'IX', 'X'] 






Enter start: -4 

Enter end: -1 






sliceString[ -4 

: -1 ] = 

ghi 




sliceTuple [ -4 : 

-1 ] = 

(7, 8, 

9) 



sliceList [ -4 : 

-1 ] = 

['VII', 

'VIII 

r 

' IX' ] 








Fig.5.8 Sequence slices. (Part2of 3.) 
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sliceString: abcdefghij 

sliceTuple: (1, 2, 3, 4, 5, 6, 7, 8, 9, 10) 

sliceList: ['I', 'II', 'III', 'IV', 'V', 'VI', 'VII', 'VIII', 

'IX■, ' X' ] 

Enter start: 0 
Enter end: 10 

sliceString[ 0 : 10 ] = abcdefghij 

sliceTuple [ 0 : 10 ] = (1, 2, 3, 4, 5, 6, 7, 8, 9, 10) 

sliceList [ 0 : 10 ] = ['I', 'II', 'III', 'IV', 'V', 'VI', 'VII', 

'VIII', 'IX', 'X'] 


Fig.5.8 Sequence slices. (Part3of 3.) 






Lines 5-18 create the three sequences and request the user to specify a beginning and 
ending index for the slice. Lines 21-28 print the specified slice for each sequence. A slice 
is simply a new sequence, created from an existing sequence. The expression in line 22 

sliceString! start:end ] 

creates (slices) a new sequence from variable sliceString. This new sequence contains 
the values stored at indices sliceString [ start ], .... sliceString [ end - 1 ] . 
In general, to obtain from sequence a slice of the /th element through the /th element, inclu- 
sive, use the expression 

sequence [ i:j + 1 ] 

Figure 5.8 includes three sample outputs from the program. The first sample creates a 
slice from indices 0 to 10 (e.g., the entire sequence). Recall that the first element in every 
sequence is the zeroth element. The sequence created from this slice is equivalent to the 
sequence created with the expression 

sequence [ : 1 

This expression creates a new sequence that is a copy of the original sequence. The above 
expression is equivalent to the following expressions: 

sequence [ 0 : len ( sequence ) ] 
sequence [ : len( sequence ) ] 
sequence [ 0:3 

The syntax for sequence slicing provides a useful shortcut for selecting a portion of an 
existing sequence. A program can use sequence slicing to create a copy of a list when 
passing the list to a function. We discuss this issue in Section 5.7 and 5.8. 

Note that negative slices cannot access the last element of a list directly (i.e. .slice¬ 
String [-4 : -1 ] = ghi) because slices apply to points between elements. With neg¬ 
ative slices, the last point between elements is the point between elements with indices -2 
and -1. 
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5.5 Dictionaries 

In addition to lists and tuples, Python supports another powerful data type, called the dic- 
tionary. Dictionaries (called hashes or associative arrays in other languages) are mapping 
constructs consisting of key-value pairs. Dictionaries can be thought of as unordered col- 
lections of values where each value is referenced through its corresponding key. For exam- 
ple, a dictionary might store phone numbers that can be referenced by a person’s name. 
The statement 


emptyDictionary = {} 

creates an empty dictionary. Notice that curly braces ({ }) denote dictionaries. To initialize 
key-value pairs for a dictionary, use the statement 

dictionary = { : , : } 

Each key-value pair is of the form 


key : value 


A comma separates each key-value pair. Dictionary keys must be immutable values, such 
as strings, numbers or tuples. Dictionary values can be of any Python data type. 

Common Programming Error 5.3 

Using a list or a dictionary for a dictionary key is an svntax error. 



Figure 5.9 demonstrates how to create, initialize, access and manipulate simple dictio¬ 
naries. Lines 5-6 create and print an empty dictionary. Line 9 creates a dictionary grades 
and initializes the dictionary to contain four key-value pairs. The keys are strings that con- 
tain student names, and the integer values represent the students’ grades. Line 10 prints the 
value assigned to variable grades. Observe that the application displays grades in a dif¬ 
ferent order than the declaration; this is because a dictionary is an unordered collection of 
key-value pairs. Also, notice in the output that the dictionary keys appear in single quotes, 
because Python displays strings in single quotes. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 


# Fig. 5.09: fig05_09.py 

# Creating, accessing and modifying a dictionary. 

# create and print an empty dictionary 

emptyDictionary = {} 

print , emptyDictionary 

# create and print a dictionary with initial values 

grades = { : : : : 

print , grades 

# access and modify an existing dictionary 

print , grades [ ] 

grades [ ] = 

print , grades[ ] 


} 


Fig. 5.9 Dictionariescreated, accessed and modified. (Part 1 of 2.) 
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16 

17 # add to an existing dictionary 

18 grades[ ] = 

19 print " \nDictionary grades 

20 print grades 

21 

22 # delete entry from dictionary 

23 dei grades [ ] 

24 print " \nDictionary grades 

25 print grades 


The value of emptyDictionary is: {} 

All grades: {'Edwin': 89, 'John': 87, 'Steve': 76, 1 Laura 1 : 92} 

Steve 1 s current grade: 76 
Steve's new grade: 90 

Dictionary grades after modification: 

{'Edwin': 89, 'Michael': 93, 'John': 87, 'Steve': 90, 'Laura': 92} 
Dictionary grades after deletion: 

{'Edwin': 89, 'Michael': 93, 'Steve': 90, 'Laura': 92} 


Fig.5.9 Dictionariescreated, accessed and modified. (Part2 of 2.\ 




Line 13 accesses a particular dictionary value, using the [] operator. Dictionary 
values are accessed with the expression 


dictionaryName [ key ] 

In line 13, the dictionaryName is grades and the key is the string "Steve". This expres¬ 
sion evaluates to the value stored in the dictionary at key "Steve", namely, 7 6. Line 14 
assigns a new value, 9 0, to the key "Steve ". Dictionary values are modified using syntax 
similar to that of modifying lists. Line 15 prints the resuit of changing the dictionary value. 

Line 18 inserts a new key-value pair into the dictionary. Although this statement 
resembles the syntax for modifying an existing dictionary value, it inserts a new key-value 
pairbecause Michael is a new key. The statement 


dictionaryName [ key ] = value 


modifies the value associated with key, if the dictionary already contains that key. Other- 
wise, the statement inserts the key-value pair into the dictionary. 



When adding a key-value pair to a dictionary, rnis-typing the key could be a source ofinad- 
vertent errors. 


Lines 19-20 print the results of adding a new key-value pair to the dictionary. The 
order in which the key-value pairs are printed is entirely arbitrary (remember that a dictio¬ 
nary is an unordered collection of key-value pairs). 
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The expression dictionaryName [ key ] can lead to subtle programming errors. If this 
expression appears on the left-hand side of an assignment statement and the dictionary does 
not contain the key, the assignment statement inserts the key-value pair into the dictionary. 
However, if the expression appears to the right of an assignment statement (or any statement 
that simply attempts to access the value stored at the specified key), then the statement 
causes the program to exit and to display an error message, because the program is trying 
to access a nonexistent key. 



Common Programming Error 5.4 


Attempting to access a nonexistent dictionary key is a “key error”, a runtime error. 


Line 23 deletes an entry from the dictionary. The statement 


dei dictionaryName [ key ] 

removes the specified key and its value from the dictionary. If the specified key does not 
exist in the dictionary, then the above statement causes the program to exit and to display 
an error message. Again, this is because the program is accessing a nonexistent key. This 
runtime emor can be caught through exception handling, which we discuss in Chapter 12. 

Dictionaries are powerful data types that help programmers accomplish sophisticated 
tasks. Many Python modules provide data types similar to dictionaries that facilitate access 
and manipulation of more complex data. In the next section, we explore the dictionary’s 
capabilities further. 


5.6 List and Dictionary Methods 

We have seen how sequences and dictionaries enable programmers to accomplish high-lev- 
el data manipulation, such as storing and retrieving data. We now introduce a new program¬ 
ming concept, the method, to extend data-manipulation capabilities. 

As discussed in Chapter 2, Introduction to Python Programming, all Python data types 
contain at least three properties: a value, a type and a location. Some Python data types (e.g., 
strings, lists and dictionaries) also contain methods. A method is a function that performs the 
behaviors (tasks) of an object. In this section, we discuss list and dictionary methods; we dis¬ 
cuss string methods in Chapter 13, Strings Manipulation and RegularExpressions. 

List methods implement several behaviors, such as appending a value to the end of a 
list or determining the index of a particular element in the list. The program of Fig. 5.10 
appends items to the end of a list, using a list method. The program asks the user to enter 
the names of Shakespearean plays and appends the names to a list. Line 4 creates an empty 
list, playList, to store the names of the plays entered by the user. The for structure 
(lines 8-10) uses list method append to append items to the end of variable playList 
Method append takes as an argument the new element to insert at the end of the list. To 
invoke the list method, specify the name of the list, followed by the dot (.) access operator, 
followed by the method call (i.e., method name and necessary arguments). Lines 14-15 
define another for loop that prints the names of the user-entered Shakespearean plays. 
Notice that line 15 uses the - formatting character to left align the names. 

Figure 5.10 demonstrates how a data type’s methods provide a way for programmers to 
create applications that perform useful data-manipulation tasks. Figure 5.11 uses another list 
method to perform a more typical data-manipulation task—counting the number of times a 







































pythonhtpl_05.fm Page 172 Saturday, December 8, 2001 9:35 AM 





172 Lists, Tuples and Dictionaries 


Chapter 5 







1 # Fig. 5.10: fig05_10.py 

2 # Appending items to a list. 

3 

4 playList = [] 

5 

6 print "Enter your 5 favorite Shakespearean plays.\n 

7 

8 for i in range ( ) : 

playName = raw_input ( % ( i + ) ) 

10 playList.append( playName ) 

11 

12 print " \nSubscript Value" 

13 

14 for i in range( len( playList ) ): 

15 print % ( i + , playList [ i ] ) 


Enter ; 

your 5 favorite 

Shakespearean plays. 

Play 1 

: Richard III 


Play 2 

: Henry V 


Play 3 

: Twelfth Night 


Play 4 

: Hamiet 


Play 5 

: King Lear 


Subscript Value 



1 Richard 

2 Henry V 

III 


3 Twelfth 

4 Hamiet 

Night 


5 King Lear 


Fig. 5.10 Appending items to a list. 



particular value occurs in a list. Lines 4-7 create a list (responses) that contains several 
values between 1-10. Lines 11-12 contain a for loop that calls list method count to return 
the amount of times an element appears in a list. Method count takes as an argument a value 
of any data type. If the list contains no elements with the specified value, method count 
returns 0. Lines 11-12 print the frequency of each value in the list. 


1 

# Fig. 5.11: fig05 11.py 


2 

# Student poli program. 


3 



4 

5 

responses 

Illi 

II II ! ! 

/ II II / 

6 

7 

Illi 

Illi 

! II II ! 

II II ! 1 

8 



9 

print "Rating 


10 



11 

for i in range ( , ) : 


12 

print % ( i. 

responses.count( i ) ) 


Fig. 5.11 List method count. (Partlof 2.) 
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Lists provide several other useful methods. Figure 5.12 summarizes these methods. 
Throughout the text, we create programs that invoke list methods to accomplish tasks. 




Method 

Purpose 

append ( item ) 

Inserts item at the end of the list. 

count ( element ) 

Returns the number of occurrences of element in the list. 

extend ( newList ) 

Inserts the elements of newList at the end of the list. 

index ( element ) 

Returns the index of the first occurrence of element in the list. 
If element is not in the list, a ValueError exception occurs. 
[Note: We discuss exceptions in Chapter 12, Exception 
Handling.] 

insert ( index, item ) 

Inserts item at position index. 

pop ( [index] ) 

Parameter index is optional. If this method is called without 
arguments. it removes and returns the last element in the list. 

If parameter index is specified, this method removes and 
returns the element at position index. 

remove ( element ) 

Removes the first occurrence of element from the list. If ele¬ 
ment is not in the list, a ValueError exception occurs. 

reverse() 

Reverses the contents of the list in place (rather than creating a 
reversed copy). 

sort ( [compare-function ] ) 

Sorts the content of the list in place. The optional parameter 
compare-function is a function that specifies the compare cri- 
teria. The compare-function takes any two elements of the list 
(x and y) and returns -1 if x should appear before y, 0 if the 
orders of x and y do not matter and 1 if x should appear after y. 
[Note: We discuss sorting in Section 5.9.] 









Fig. 5.12 List methods 
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The dictionary data type also provides many methods that enable the programmer to 
manipulate the stored data. Figure 5.13 demonstrates three dictionary methods. Lines 4-7 
create the dictionary monthsDictionary that represents the months of the year. Line 
10 uses dictionary method items to print the dictionary’s key-value pairs to the screen. 
The method retums a list of tuples, where each tuple contains a key-value pair. 




1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 


# Fig. 5.13: fig05_13.py 

# Dictionary methods. 


monthsDictionary = { 


print "The dictionary items are:" 

print monthsDictionary.items() 

print " \nThe dictionary keys are:" 

print monthsDictionary.keys() 

print "\nThe dictionary values are 

print monthsDictionary.values() 

print "\nUsing a for loop to get di 

for key in monthsDictionary.keys(): 
print , key. 


, monthsDictionary[ key ] 


The dictionary items are: 

[(1, 'January'), (2, 'February'), (3, 'Mardi'), (4, 'April'), (5, 
'May'), (6, 'June'), (7, 'July'), (8, 'August'), (9, 'September'), (10, 
'October'), (11, 'November'), (12, 'December')] 

The dictionary keys are: 

[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12] 


The dictionary values are: 

['January', 'February', 'March', 'April', 'May', 'June', 'July', 
gust', 'September', 'October', 'November', 'December'] 


Using a 

monthsDi 

monthsDi 

monthsDi 

monthsDi 

monthsDi 

monthsDi 

monthsDi 

monthsDi 

monthsDi 

monthsDi 

monthsDi 

monthsDi 


for loop to get 
ctionaryt 1 ] = 
ctionaryt 2 ] = 
ctionaryt 3 ] = 
ctionaryt 4 ] = 
ctionaryt 5 ] = 
ctionaryt 6 ] = 
ctionaryt 7 ] = 
ctionaryt 8 ] = 
ctionaryt 9 ] = 
ctionaryt 10 ] = 
ctionaryt 11 ] = 
ctionaryt 12 ] = 


dictionary items: 

January 

February 

March 

April 

May 

June 

July 

August 

September 

: October 

: November 

: December 


'Au- 






Fig. 5.13 Dictionary methods items, keys and values. 
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Dictionary method keys (line 13) returns an unordered list of the dictionary’s keys. 
Similarly, dictionary method values (line 16) returns an unordered list of the dictionary’s 
values. Lines 20-21 demonstrate a common use of dictionary method keys. The for loop 
iterates over the dictionary keys. Each key is assigned to control variable key. Line 21 
prints both the key and the value associated with that key. Figure 5.14 summarizes the dic¬ 
tionary methods. 




Method 

Desc ription 

ciear() 

Deletes all items from the dictionary. 

copy() 

Creates and returns a shallow copy of the dictionary (the 
elements in the new dictionary are references to the ele- 
ments in the original dictionary). 

get ( key [, retumValue] ) 

Returns the value associated with key. If key is not in the 
dictionary and if retumValue is specifted, returns the 
specified value. If retumValue is not specified, returns 

None. 

has key ( key ) 

Returns 1 if key is in the dictionary; returns 0 if key is not 
in the dictionary. 

items() 

Returns a list of tuples that are key-value pairs. 

keys() 

Returns a list of keys in the dictionary. 

popitem () 

Removes and returns an arbitrary key-value pair as a 
tuple of two elements. If dictionary is empty, a Key- 
Error exception occurs. [Note: We discuss exceptions 
in Chapter 12, Exception Handling.] This method is use- 
ful for accessing an element (i.e., print the key-value 
pair) before removing it from the dictionary. 

setdef ault ( key [. dummyValue] ) 

Behaves similarly to method get. If key is not in the dic¬ 
tionary and dummyValue is specified, inserts the key and 
the specified value into dictionary. If dummyValue is not 
specified, value is None. 

update ( newDictionary ) 

Adds all key-value pairs from newDictionary to the cur¬ 
rent dictionary and overrides the values for keys that 
already exist. 

values () 

Returns a list of values in the dictionary. 

iterkeys( ) 

Returns an iterator of dictionary keys. [Note: We discuss 
iterators in Appendix O, Additional Python 2.2 Features.] 

iteritems () 

Returns an iterator of key-value pairs. [Note: We discuss 
iterators in Appendix O, Additional Python 2.2 Features.] 

itervalues () 

Returns an iterator of dictionary values. [Note: We dis¬ 
cuss iterators in Appendix O, Additional Python 2.2 
Features.] 









Fig. 5.14 Dictionary methods 
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Dictionary method copy returns a new dictionary that is a shallow copy of the original 
dictionary. In a shallow copy, the elements in the new dictionary are references to the ele- 
ments in the original dictionary. 

The interactive session in Fig. 5.15 demonstrates the difference between shallow and 
deep copies. We first create dictionary, which contains one value—a list of numbers. 
We then invoke dictionary method copy to create a shallow copy of dictionary, and 
we assign the copy to variable shallowCopy. The values stored for key " listKey" in 
both dictionaries reference the same object. To underscore this fact, we insert the value 4 
at the end of the list stored in dictionary. We then print the value of variables dic¬ 
tionary and shallowCopy. Notice that the list has been changed in both copies of the 
dictionary. This is a consequence of doing a shallow copy, which does not create a fully 
independent copy of the original dictionary. 

Sometimes, a shallow copy is sufficient for a program, especially if the dictionaries 
contain no references to other Python objects (i.e., they contain only literal numeric values 
or immutable values). However, sometimes it is necessary to create a copy—called a deep 
copy —that is independent of the original dictionary. To create a deep copy, Python pro¬ 
vides module copy. The remainder of the interactive session in Fig. 5.15 creates a deep 
copy of variable dictionary. We first import function deepcopy from module copy. 
We then call deepcopy and pass dictionary as an argument. The function call returns 
a deep copy of dictionary, and we assign the copy to variable deepCopy. The value 
associated with deepCopy [ "listKey" ] is now independent of the value associated 
with that key in variables dictionary and shallowCopy. To demonstrate this fact, 
we append a new value to dictionary’s list and print the values for dictionary, 
shallowCopy and deepCopy. 


Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 
win32 

Type "help", "Copyright", "credits" or "license" for more informa- 
tion. 

>>> dictionary = { "listKey" : [ 1, 2, 3 ] } 

>>> shallowCopy = dictionary.copy() # make a shallow copy 

>>> dictionary[ "listKey" ].append( 4 ) 

>>> print dictionary 
{'listKey': [1,2, 3, 4]} 

>>> print shallowCopy 
{'listKey': [1, 2, 3, 4]} 


>>> from copy import deepcopy 

>>> deepCopy = deepcopy( dictionary ) # make a deep copy 

>>> dictionary! "listKey" ].append( 5 ) 

>>> print dictionary 
{'listKey': [1, 2, 3, 4, 5]} 

>>> print shallowCopy 
{'listKey': [1, 2, 3, 4, 5]} 

>>> print deepCopy 
{'listKey': [1, 2, 3, 4]} 


Fig. 5.15 Difference between a shallow copy and a deep copy. 
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Shallow and deep copies reflect how Python handles references (i.e., names of 
objects). The programmer should exercise caution when dealing with references to objects 
like lists and dictionaries, because changing an object affects the value of all the names that 
refer to that object. In the next two sections, we discuss how passing a reference to a func- 
tion affects an object’s value. 



deepCopyList = originalList[ :] does a deep copy which means that the deep- 
CopyList is a deep copy ofthe originalList. 


5.7 References and Reference Para mete rs 


To perform tasks, functions require certain input values, which the main program or func- 
tions have (or know). The main program (e.g., a program that simulates a calculator) may 
ask users for input, and those input values are sent, in turn, to functions (e.g., add, sub- 
tract). The values, or arguments, have to be passed to the functions through a certain pro- 
tocol. In many programming languages, the two ways to pass arguments to functions are 
pass-by-value and pass-by-reference. When an argument is passed by value, a copy of the 
argument’s value is made and passed to the called function. 



Testing and Debugging Tif 


With pass-by-value, changes to the called function 's copy do not affect the original vari- 
able’s value in the calling code. This prevents Occidental side ejfects that can hinder the de- 
velopment ofcorrect and reliable Software systems. 


With pass-by-reference, the caller allows the called function to access the caller’s data 
directly and to modify that data. Pass-by-reference can improve performance by elimi- 
nating the overhead of copying large amounts of data. However, pass-by-reference can 
weaken security, because the called function can access the caller’s data. 

Unlike many other languages, Python does not allow programmers to choose between 
pass-by-value and pass-by-reference when passing arguments. Python arguments are always 
passed by object reference —the function receives references to the values passed as argu¬ 
ments. In practice, pass-by-object-reference can be thought of as a combination of pass-by- 
value and pass-by-reference. If a function receives a reference to a mutable object (e.g., a dic- 
tionary or a list), the function can modify the original value of the object. It is as if the object 
had been passed by reference. If a function receives a reference to an immutable object (e.g., 
a number, a string or a tuple, whose elements are immutable values), the function cannot 
modify the original object directly. It is as if the object had been passed by value. 

As always, it is important for the programmer to be aware of when an object may be 
modified by the function to which it is passed. Remembering the preceding rules and under- 
standing how Python treats references to objects is essential to creating large and sophisti- 
cated Python systems. 


5.8 Rassing Lists to Functions 

In this section, we discuss references further by examining what happens when a program 
passes a list to a function. The results we discover hold true for other mutable Python ob¬ 
jects, such as dictionaries. To pass a list argument to a function, specify the name of the list 
without squarebrackets. For example, if list hourlyTemperatures has been created as 
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hourlyTemperatures = [ , , ] 

the function call 

modifyList( hourlyTemperatures ) 

passes list hourlyTemperatures to function modifyList. 

Although entire lists can be changed by a function, individual list elements that are 
numeric or immutable sequence data types cannot be changed. To pass a list element to a 
function, use the subscripted name of the list element as an argument in the function call. 

The program of Fig. 5.16 demonstrates the difference between passing an entire list and 
passing a list element. Line 12 creates variable aList. The for loop at lines 17-18 prints 
the items of the list. Line 20 invokes function modi f yLi s t and passes the function variable 
aList. Function modifyList (lines 4—7) multiplies each element by 2. To illustrate that 
aList’s elements are modified, the for loop at lines 24—25 displays the list elements again. 
As the output shows, the elements of aList were modified by modifyList. 






1 

# Fig. 5.16: fig05 16.py 


2 

# Passing lists and individual list 

elements to functions. 

3 



4 

def modifyList ( aList ) : 


5 



6 

for i in range( len ( aList ) ) : 


7 

aList [ i ] * = 


8 



9 

def modifyElement( element ): 


10 

element *= 


11 



12 

aList =[,,,, ] 


13 



14 

print "Effects of passing entire lia 


15 

print "The values of the original 1: 


16 



17 

for item in aList: 


18 

print item. 


19 



20 

modifyList ( aList ) 


21 



22 

print " \n\nThe values of the modifia 


23 



24 

for item in aList: 


25 

print item. 


26 



27 

print "\n\nEffects of passing list « 


28 

print "aList[ 3 ] before modifyElema 

, aList! ] 

29 

modifyElement ( aList [ ] ) 


30 

print "aList! 3 ] after modifyElemei 

, aList [ ] 

31 



32 

print "\nEffects of passing slices < 


33 

print "aList! 2:4 ] before modifyLia 

, aList! : ] 

34 

modifyList! aList! : ] ) 


35 

print "aList! 2:4 ] after modifyList 

, aList! : ] 


Fig.5.16 Passing listsand individual list elements to methods. (Part 1 of 2.) 
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Effects of passing entire list: 

The values of the original list are: 

1 2 3 4 5 

The values of the modified list are: 

2 4 6 8 10 


Effects of passing list element: 
aList [ 3 ] before modifyElement: 8 
aList [ 3 ] after modifyElement: 8 


Effects of passing slices of list: 
aList [ 2:4 ] before modifyList: [6, 8] 
aList [ 2:4 ] after modifyList: [6, 8] 


Fig.5.16 Passing listsand individual list elementsto methods. (Part 2 of 2.) 


Lines 27-30 demonstrate passing a list element (aList [ 3 ], which contains a 
number, recall that numbers are immutable) to a function. The program first prints the value 
of aList [ 3 ], which is 8. Then, the program calls function modifyElement (lines 9- 
10) passing to parameter element the value 8. Function modifyElement multiplies 
element by 2. When the function terminates, the local variable element is destroyed. 
The value of the original element, aList [ 3 ] , in the list is not modified because the value 
of aList [ 3 ] is immutable. Thus, when control is returned to the main portion of the 
program, the unmodified value of aList [ 3 ] is printed. 

Slicing creates a new sequence; therefore, when a program passes a slice to a function, 
the original sequence is not affected. Line 33 prints the slice aList [2:4] to the screen. 
Line 34 calls function modifyList and passes aList [ 2 : 4 ]. Line 35 prints the resuit 
of calling function modifyList —demonstrating that the original list was not modified. 

Notice that function modifyList iterates through its list by accessing the elements 
using the square bracket operator. If the function contained the code 

for item in aList: 
item *= 

the list would remain unchanged, because the function would modify the value of local 
variable item and not the value stored at a particular index in the list. 


5.9 Sorting and Searching Lists 

Sorting data (i.e., placing the data into a particular order, such as ascending or descending) 
is a common computing application. For instance, a bank sorts checks by account number 
to prepare individual monthly bank statements. Telephone companies sort accounts by last 
names and, within that, by first names, to simplify the search for phone numbers. Almost 
all organizations sort data—in many cases, massive amounts of data. Sorting data is an in- 
triguing problem that has attracted some of the most intense research efforts in the field of 
computer Science. In this section, we discuss how to sort a list using list method sort. 

Figure 5.17 sorts the values of the 10-element list aList (line 4) into ascending order. 
Lines 8-9 print the list items. Line 11 calls list method sort— this method sorts the ele- 

































pythonhtpl_05.fm Page 180 Saturday, December 8, 2001 9:35 AM 





180 Lists, Tuples and Dictionaries 


Chapter 5 




ments of aList in ascending order. The remainder of the program prints the results of 
sorting the list. 

Much research has been performed in the area of list-sorting algorithms, resulting in 
the design of many algorithms. Some of these algorithms are simple to express and pro¬ 
gram, but are inefficient. Other algorithms are complex and sophisticated, but provide 
increased performance. The exercises at the end of this chapter investigate a well-known 
sorting algorithm. 



Performance Tip 5.1 

1 Sometimes, the simplest algorithms perform poorly. Their virtue is that they are easy to 
write, test and debug. Sometimes complex algorithms are needed to realize maximum per¬ 
formance. 


Often, programmers work with large amounts of data stored in lists. It might be neces- 
sary to determine whether a list contains a value that matches a certain key value. The pro- 
cess of locating a particular element value in a list is called searching. 

The program in Fig. 5.18 searches a list for a value. Line 5 creates list aList, which 
contains the even numbers between 0 and 198, inclusive. Line 7 then retrieves the search 
key from the user and assigns the value to variable searchKey. Keyword in tests 
whether list aList contains the user-entered search key (line 9). If the list contains the 
value stored in variable searchKey, the expression (line 9) evaluates to true; otherwise, 
the expression evaluates to false. 


1 # Fig. 5.17: fig05JL7.py 

2 # Sorting a list. 

3 

4 aList =[,,,, , , , , , 1 

5 

6 print "Data items in original order" 

7 

8 for item in aList: 

9 print item, 

10 

11 aList.sort () 

12 

13 print "\n\nData items after sorting" 

14 

15 for item in aList: 

16 print item, 

17 

18 print 









Fig.5.17 Sorting a list. 
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1 # Fig. 5.18: fig05_18.py 

2 # Searching a list for an integer. 

3 

4 # Create a list of even integers 0 to 198 

5 aList = range( , , ) 

6 

7 searchKey = int( rawinput( ) ) 

8 

9 if searchKey in aList: 

10 print , aList.index( searchKey ) 

11 else: 

12 print 'Value not found" 



If the list contains the search key, line 10 invokes list method index to obtain the 
index of the search key. List method index takes a search key as a parameter, searches 
through the list and returns the index of the first list value that matches the search key. If 
the list does not contain any value that matches the search key, the program displays an 
error message. [Note: Figure5.18 searches aList twice (lines 9-10), which, for large 
sequences, can resuit in poor performance. To improve performance, the program can use 
list method index and trap the exception that occurs if the argument is not in the list. We 
discuss exception-handling techniques in Chapter 12.] 

As with sorting, a great deal of research has been devoted to the task of searching. In 
the exercises at the end of this chapter, we explore some of the more sophisticated ways of 
searching a list. 

5.10 Multiple-Subsciipted Sequences 

Sequences can contain elements that are also sequences (i.e., lists and tuples). Such se¬ 
quences have multiple subscripts. A common use of multiple-subscripted sequences is to 
represent tables of values consisting of information arranged in rows and columns. To iden- 
tify a particular table element, we must specify two subscripts—by convention, the first 
identifies the element’s row, the second the element’s column. 

Sequences that require two subscripts to identify a particular element are called 
double-subscripted sequences or two-dimensional sequences. Note that multiple-sub¬ 
scripted sequences can have more than two subscripts. Python does not support multiple- 
subscripted sequences directly, but allows programmers to specify single-subscripted 
tuples and lists whose elements are also single-subscripted tuples and lists, thus achieving 
the same effect. Figure 5.19 illustrates a double-subscripted sequence, a, containing three 
rows and four columns (i.e., a 3-by-4 sequence). In general, a sequence with m rows and n 
columns is called an m-by-n sequence. 
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Column 0 

Column 1 

Column 2 

Column 3 

Row 0 

a [0] [0] 

a [0] [1] 

a[0] [2] 

a [0] [3] 

Row 1 

a [1] [0] 

a [1] [1] 

a[1] [2] 

a [1] [3] 

Row 2 

a[2] [0] 

a[2] [1] 

___i_ 

a[2] [2] 

a[2] [3] 


Column subscript 
Row subscript 
Sequence na me 




Fig. 5.19 Double-subscripted sequence with three nowsand fourcolumns. 


Every element in sequence a is identified in Fig. 5.19 by an element name of the form 
a [ i ] [ j ] ; a is the name of the sequence, and i and j' are the subscripts that uniquely 
identify the row and column of each element in a. Notice that the names of the elements in 
the first row all have 0 as the first subscript; the names of the elements in the fourth column 
ali have 3 as the second subscript. 

Multiple-subscripted sequences can be initialized during creation in much the same 
way as a single-subscripted sequence. A double-subscripted list with two rows and columns 
could be created with 


b = [ [ 


1 , [ 


1 1 


The values are grouped by row—the first row is the first element in the list, and the second 
row is the second element in the list. So, 1 and 2 initialize b [ 0 ] [ 0 ] and b [ 0 ] [ 1 ], 
and 3 and 4 initialize b [ 1 ] [ 0 ] and b [ 1 ] [ 1 ]. Multiple-subscripted sequences are 
maintained as sequences of sequences. The statement 


c = ( ( , ) , ( , , ) ) 

creates a tuple c with row 0 containing two elements (1 and 2) and row 1 containing three 
elements (3, 4 and 5). Python allows multiple-subscripted sequences to have rows of dif¬ 
ferent lengths. 

Figure 5.20 demonstrates creating and initializing double-subscripted sequences and 
using nested for structures to traverse the sequences (i.e., manipulate every element of the 
sequence). 


1 # Fig. 5.20: fig05 20.py 

2 # Making tables using lists of lists and tuples of tuples. 

3 

4 tablel = [ [ , ] , [ , ] 1 

5 table2 = ( ( , ), ( , ) , ( , , ) ) 

6 








Fig.5.20 Tablescreated using lists of listsand tuplesof tuples. (Part 1 of 2.) 
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7 print "Values in ta 

8 

9 for row in tablel: 

10 

11 for item in row: 

12 print item, 

13 

14 print 

15 

16 print "\nVal 

17 

18 for row in table2: 

19 

20 for item in row: 

21 print item, 

22 

23 print 



The program declares two sequences. Line 4 creates the multiple-subscript list 
tablel and provides six values in two sublists (i.e., two lists-within-lists). The first sub- 
list (row) of the sequence contains the values 1, 2 and 3; the second sublist contains the 
values 4, 5 and 6. 

Line 5 creates multiple-subscript tuple table2 and provides six values in three sub- 
tuples (i.e., tuples-within-tuples). The first subtuple (row) contains two elements with 
values 1 and 2, respectively. The second subtuple contains one element with value 3. The 
third subtuple contains three elements with values 4, 5 and 6. Lines 9-14 use a nested for 
structure to output the rows of list tablel. The outer for structure iterates over the rows 
in the list. The inner for structure iterates over each column in the row. The remainder of 
the program prints the values for variable table2 in a similar manner. 

The program in Fig. 5.20 demonstrates one case in a which a for structure is useful 
for manipulating a multiple-subscripted sequence. Many other common sequence manipu- 
lations use for repetition structures. For example, the following for structure sets all the 
elements in the third row of sequence a in Fig. 5.19 to 0: 

for column in range( len( a[ 1 ) ): 

a [ ] [ column ] = 

We specified the third row; thus, the first subscript is always 2 (0 is the first row and 1 is 
the second row). The for structure varies only the second subscript (i.e., the column sub¬ 
script). The preceding for structure is equivalent to the assignment statements 


































pythonhtpl_05.fm Page 184 Saturday, December 8, 2001 9:35 AM 




184 Lists, Tuples and Dictionaries 


Chapter 5 






a[ ][ ] = 

a [ ] [ ] = 

a [ ] [ ] = 

a [ ] [ ] = 

The following nested for structure determines the total of all the elements in sequence a: 

total = 

for row in a: 

for column in row: 
total += column 

The for structure totals the elements of the sequence one row at a time. The outer for struc¬ 
ture iterates over the rows in the table so that the elements of each row may be totaled by the 
inner for structure. The total is displayed when the nested for structure terminates. 

The program in Fig. 5.21 performs several other common sequence manipulations on 
the 3-by-4 list grad.es. Each row of the list represents a student, and each column repre- 
sents a grade on one of the four exams the students took during the semester. The list 
manipulations are performed by four functions. Function printGrades (lines 5-25) 
prints the data stored in list grades in a tabular format. Function minimum (lines 28-38) 
determines the lowest grade of any student for the semester. Function maximum (lines 41- 
51) determines the highest grade of any student for the semester. Function ave rage (lines 
54-60) determines a particular student’s semester average. Notice that line 55 initializes 
total to 0.0, so the function returns a floating-point value. 


1 # Fig. 5.21: fig05_21.py 

2 # Double-subscripted list example. 

3 

4 


5 

def printGrades( grades ) : 




6 

students = len( 

grades ) 


# 

number of students 

7 

exams = len( grades! ] 

) 

# 

number of exams 

8 






9 

# print table headers 




10 

print "The list 





11 

print 

/ 




12 






13 

for i in range( 

exams ): 




14 

print [%d]" 

% i. 




15 






16 

print 





17 






18 

# print scores. 

by row 




19 

for i in range( 

students 

) : 



20 

print "grade: 

% 

i. 



21 






22 

for j in range( exams 

) : 



23 

print grades[ i ] [ 

j 1 

/ 

# 

24 






25 

print 






Fig. 5.21 Double-scripted tuples. (Part 1 of 3.) 
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def minimum( grades ): 
lowScore = 

for studentExams in grades: 

for score in studentExams: 

if score < lowScore: 
lowScore = score 

return lowScore 


def maximum( grades ): 
highScore = 

for studentExams in grades: 

for score in studentExams: 

if score > highScore: 
highScore = score 

return highScore 



def average( setOfGrades ) : 
total = 

for grade in setOfGrades: 
total += grade 

return total / len( setOfGrades ) 

# main program 

grades = [ [ , , 

[ 

[ 

printGrades( grades ) 
print , minimum( grades ) 

print , maximum( grades ) 

print " \n" 

# print average for each student 

for i in range( len( grades ) ): 

print , i, , average( grades[ i ] ) 


] , 

] , 

] ] 








Fig. 5.21 Double-scripted tuples. (Part2of 3.) 
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Function printGrades uses the list grades and variables students (numberof 
rows in the list) and exams (number of columns in the list). The function loops through list 
grades, using nested for structures to print out the grades in tabular format. The outer 
for structure (lines 19-25) iterates over i (i.e., the row subscript), the inner for structure 
(lines 22-23) over j (i.e., the column subscript). 

Functions minimum and maximum loop through list grades, using nested for 
structures. Function minimum compares each grade to variable lowScore. If a grade is 
less than lowScore, lowScore is set to that grade (line 36). When execution of the 
nested structure is complete, lowScore contains the smallest grade in the double-sub- 
scripted list. Function maximum works similarly to function minimum. 

Function average takes one argument—a single-subscripted list of test results for a 
particular student. When line 75 invokes average, the argument is grades [ i ], which 
specifies that a particular row of the double-subscripted list grades is to be passed to 
average. For example, the argument grades [ 1 ] represents the four values (a single- 
subscripted list of grades) stored in the second row of the double-subscripted list grades. 
Remember that, in Python, a double-subscripted list is a list with elements that are single- 
subscripted lists. Function average calculates the sum of the list elements, divides the 
total by the number of test results and returns the floating-point resuit. 

In the above example, we demonstrated how to use double-subscripted lists. However, 
when we need to compute pure numerical problems (i.e., multi-dimensional arrays), the 
basic Python language cannot handle them efficiently. In this case, a package called NumPy 
should be used. The NumPy (numerical python) package contains modules that handle 
arrays, and it provides multi-dimensional array objects for efficient computation. For more 
information on NumPy, visit sourcef orge . net/pro j ects/numpy. 

Chapters 2-5 introduced the basic-programming techniques of Python. In Chapter 6, 
Introduction to the Common Gateway Interface (CGI), we will use these techniques to 
design Web-based applications. In Chapters 7-9, we will introduce object-oriented pro- 
gramming techniques that will allow us to build complex applications in the latter half of 
the book. 
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SUMMARY 

• Data structures hold and organize information (data). 

• Sequences, often called arrays in other languages, are data structures that store related data items. 
Python supports three basic sequence data types: a string, a list and a tuple. 

• A sequence element may be referenced by writing the sequence name foliowed by the element's 
position number in square brackets ([ ]). The first element in a sequence is the zeroth element. 

• Sequences can be accessed from the end of the sequence by using negative subscripts. 

• The position number more formally is called a subscript (or an index), which must be an integer 
or an integer expression. If a program uses an integer expression as a subscript, Python evaluates 
the expression to determine the location of the subscript. 

• Some types of sequences are immutable—the sequence cannot be altered (e.g., by changing the 
value of one of its elements). Python strings and tuples are immutable sequences. 

• Some sequences are mutable—the sequence can be altered. Python lists are mutable sequences. 

• The length of the sequence is determined by the function call len ( sequence ). 

• To create an empty string, use the empty quotes (i.e., " ", 1 1 ," " " " " " or 1 ' 1 1 1 ') 

• To create an empty list, use empty square brackets (i.e.. []). To create a list that contains a se¬ 
quence of values, separate the values with commas, and place the values inside square brackets. 

• To create an empty tuple, use the empty parentheses (i.e., ()). To create a tuple that contains a 
sequence of values, simply separate the values with commas. Tuples also can be created by sur- 
rounding the tuple values with parentheses; however, the parentheses are optional. 

• Creating a tuple is sometimes referred to as packing a tuple. 

• When creating a one-element tuple—called a singleton—write the value, followed by a comma (,). 

• In practice, Python programmers distinguish between tuples and lists to represent different kinds 
of sequences, based on the context of the program. 

• Although lists are not restricted to homogeneous data types, Python programmers typically use 
lists to store sequences of homogeneous values—values of the same data type. In general, a pro¬ 
gram uses a list to store homogeneous values for the puipose of looping over these values and per- 
forming the same operation on each value. Usually, the length of the list is not predetermined and 
may vary over the course of the program. 

• The += augmented assignment statement can insert a value in a list. When the value to the left of 
the += symbol is a sequence, the value to the right of the Symbol must be a sequence also. 

• The for/in structure iterates over a sequence. The for structure starts with the first element in 
the sequence, assigns the value of the first element to the control variable and executes the body 
of the for structure. Then, the for structure proceeds to the next element in the sequence and 
performs the same operations. 

• If a program attempts to access a nonexistent index, the program exits and displays an “out-of- 
range” error message. This error can be caught as an exception. 

• Tuples store sequences of heterogeneous data. Each data piece in a tuple represents a part of the 
total information represented by the tuple. Usually, the length of the tuple is predetermined and 
does not change over the course of a program’s execution. A program usually does not iterate over 
a sequence, but accesses the parts of the tuple the program needs to perform its task. 

• If a program attempts to modify a tuple, the program exits and displays an error message. 

• Sequences can be unpacked—the values stored in the sequence are assigned to various identifiers. 
Unpacking is a useful programming shortcut for assigning values to multiple variables in a single 
statement. 
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• When unpacking a sequence, the number of variable names to the left of the = Symbol must equal 
the number of elements in the sequence to the right of the Symbol. 

• Python provides the slicing capability to obtain contiguous regions of a sequence. 

• To obtain a slice of the ith element through the yth element, inclusive, use the expression se¬ 
quence [ i : j + 1 ]. 

• The dictionary is a mapping construet that consists of key-value pairs. Dictionaries (called hashes 
or associative arrays in other languages), can be thought of as unordered collections of values 
where each value is accessed through its corresponding key. 

• To create an empty dictionary, use empty curly braces (i.e., { }). 

• To create a dictionary with values, use a comma-separated sequence of key-value pairs, inside 
curly braces. Each key-value pair is of the form key : value. 

• Python dictionary keys must be inrmutable values, like strings. numbers or tuples, whose elements 
are immutable. Dictionary values can be of any Python data type. 

• Dictionary values are accessed with the expression dictionaryName[ key ]. 

• To insert a new key-value pair in a dictionary, use the statement dictionaryName [ key ] = value. 

• The statement dictionaryName [ key ] = value modifies the value associated with key, if the dictio¬ 
nary already contains that key. Otherwise, the statement inserts the key-value pair into the dictionary. 

• Accessing a non-existent dictionary key causes the program to exit and to display a “key error” 
message. 

• A method performs the behaviors (tasks) of an object. 

• To invoke an object’s method, specify the name of the object, followed by the dot (.) access op¬ 
erator, followed by the method invocation. 

• List method append adds an items to the end of a list. 

• List method count takes a value as an argument and returns the number of elements in the list 
that have that value. If the list contains no elements with the specified value, method count re- 
tums 0. 

• Dictionary method items returns a list of tuples, where each tuple contains a key-value pair. Dic¬ 
tionary method keys returns an unordered list of the dictionary’ s keys. Dictionary method val - 
ues returns an unordered list of the dictionary’s values. 

• Dictionary method copy returns a new dictionary that is a shallow copy of the original dictionary. 
In a shallow copy, the elements in the new dictionary are references to the elements in the original 
dictionary. 

• If the programmer wants to create a copy—called a deep copy—that is independent of the original 
dictionary, Python provides module copy. Function copy. deepeopy returns a deep copy of it 
argument. 

• In many programming languages, the two ways to pass arguments to functions are pass-by-value 
and pass-by-reference (also called pass-by-value and pass-by-reference). 

• When an argument is passed by value, a copy of the argument’s value is made and passed to the 
called function. 

• With by reference, the caller allows the called function to access the caller’s data directly and to 
modify that data. 

• Unlike many other languages, Python does not allow programmers to choose between pass-by-val¬ 
ue and pass-by-reference to pass arguments. Python arguments are always passed by object refer¬ 
ence—the function receives references to the values passed as arguments. In practice, pass-by- 
object-reference can be thought of as a combination of pass-by-value and pass-by-reference. 
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• If a function receives a reference to a mutable object (e.g., a dictionary or a list), the function can 
modify the original value of the object. It is as if the object had been passed by reference. 

• If a function receives a reference to an immutable object (e.g., a number, a string or a tuple whose 
elements are immutable values), the function cannot modify the original object directly. It is as if 
the object had been passed by value. 

• To pass a list argument to a function, specify the nanie of the list without square brackets. 

• Although entire lists can be changed by a function, individual list elements that are numeric and 
immutable sequence data types cannot be changed. To pass a list element to a function, use the 
subscripted name of the list element as an argument in the function call. 

• Slicing creates a new sequence; therefore, when a program passes a slice to a function, the original 
sequence is not affected. 

• Sorting data is the process of placing data into a particular order. 

• By default, list method sort sorts the elements of a list in ascending order. 

• Some sorting algorithms are simple to express and program, but are inefficient. Other algorithms 
are complex and sophisticated. but provide increased performance. 

• Often, programmers work with large amounts of data stored in lists. It might be necessary to de- 
termine whether a list contains a value that matches a certain key value. The process of locating a 
particular element value in a list is called searching. 

• Keyword in tests whether a sequence contains a particular value. 

• List method index takes a search key as a parameter, searches through the list and returns the 
index of the first list value that matches the search key. If the list does not contain any value that 
matches the search key, the program displays an error message. 

• Sequences can contain elements that are also sequences. Such sequences have multiple subscripts. 
A common use of multiple-subscripted sequences is to represent tables of values consisting of in- 
formation arranged in rows and columns. 

• To identify a particular table element, we must specify two subscripts—by convention, the first 
identifies the element’s row, the second identifies the element’s column. 

• Sequences that require two subscripts to identify a particular element are called double-subscript- 
ed sequences or two-dimensional sequences. 

• Python does not support multiple-subscripted sequences directly, but allows programmers to spec¬ 
ify single-subscripted tuples and lists whose elements are also single-subscripted tuples and lists, 
thus achieving the same effect. 

• A sequence with m rows and n columns is called an m-by-n sequence. It is more commonly know 
as two-dimensional sequence. 

• The name of every element in a multiple-subscripted sequence is of the form a [ i ] [ j ], where 
a is the name of the sequence, and i and j are the subscripts that uniquely identify the row and 
column of each element in the sequence. 

• To compute pure numerical problems (i.e., multi-dimensional arrays), use package NumPy (nu- 
merical Python). This package contains modules that handle arrays and provides multi-dimension¬ 
al array objects for efficient computation. 

TERMINOLOGY 

append method of list 

array 

associative array 



bracket operator ([ ] ) 
ciear method of dictionary 
column 
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comma (,) 

copy method of dictionary 

count list method 

data structure 

deep copy of a dictionary 

dictionary 

dictionary method 

double-subscripted sequence 

dot access operator (.) 

element 

empty curly braces { } 
empty dictionary 
empty list 

empty parentheses () 

empty quotes 

empty square brackets [ ] 

empty string 

empty tuple 

for structure 

get method of dictionary 

hash 

has_key method of dictionary 
heterogeneous data (in tuples) 
histogram 

homogeneous data (in lists) 
immutable sequence 
in keyword 
index 

in-place sorting 

index method of list 

items method of dictionary 

iteritems method of dictionary 

iterkeys method of dictionary 

itervalues method of dictionary 

keys method of dictionary 

key value 

key-value pair 

length (sequence) 

list 

list method 


m-by-n sequence 
mapping construet 
method 

method invocation 
multiple-subscripted sequence 
mutable sequence 
name (sequence) 

NumPy package (numerical Python) 
one-element tuple (singleton) 
out-of-range error message 
packed 

packing a tuple 
pass-by-object-reference 
pass-by-reference 
pass-by-value 

popitem method of dictionary 

position number 

row 

search 

search key 

sequence 

sequence slicing 

sequence unpacking 

setdefault method of dictionary 

shallow copy of a dictionary 

singleton 

slice a sequence 

slicing operator ([: ]) 

sort 

sort list method 

subscript 

table 

tuple 

two-dimensional sequence 
update method of dictionary 
unpacked sequence 
value (sequence) 
values dictionary method 
zeroth element 


SELF-REVIEW EXERCISES 

5.1 Fili in the blanks in each of the following statements: 

a) _are “associative arrays” that consist of_pairs. 

b) The last element in a sequence can always be accessed with subscript 

c) Statement_creates a singleton aTuple. 

d) Function_returns the length of a sequence. 

e) Selecting a portion of a sequence with the operator [: ] is called_ 

f) Dictionary method_returns a list of key-value pairs. 
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g) When an argument is passed_, a copy of the argument’s value is made and 

passed to the called method. 

h) Use the expression_to obtain the ith element through the yth element of list 

sequence, inclusive. 

i) A sequence with m rows and n columns is called an_. 

j) List method_returns the number of times a specified element occurs in a list. 

5.2 State whether each of the following is true or false. If false, explain why. 

a) A sequence begins at subscript 1. 

b) Strings and tuples are mutable sequences. 

c) Each key-value pair in a dictionary has the form key : value. 

d) Using a tuple as a dictionary key is an error. 

e) Dictionary values are accessed with the dot operator. 

f) Method insert adds one element to the end of a list. 

g) The += statement appends items into lists. 

h) List method sort sorts the elements of a list in place. 

i) If list method search finds a list value that matches the search key, it returns the sub¬ 
script of the list value. 

j) Unlike other languages, Python does not allow the programmer to choose whether to pass 
each argument pass-by-value or pass-by-reference. 


ANSWERS TO SELF-REVIEW EXERCISES 

5.1 a) Dictionaries, key-value. b) -1. c) aTuple = 1,. d) len. e) slicing. D items. g) pass-by- 
value. h) sequence [ i : j + 1] . i) m-by-n sequence. j) count. 

5.2 a) False. The flrst element in every sequence has subscript 0. b) False. Strings and tuples are 
immutable sequences—their values cannot be altered. c) True. d) False. Dictionary keys must be im- 
mutable data types, such as tuples. e) False. Dictionary values are accessed with the expression dic- 
tionaryName [ key ] . f) False. Method append adds one element to the end of a list. g) True. 
h) True. i) False. If list method index finds a list value that matches the search key, it returns the 
subscript of the list value. j) True. 




EXERCISES 

5.3 Use a list to solve the following problem: Read in 20 numbers. As each number is read, print 
it only if it is not a duplicate of a number already read. 

5.4 Use a list of lists to solve the following problem. A company has four salespeople (1 to 4) 
who sell five different products (1 to 5). Once a day, each salesperson passes in a slip for each differ¬ 
ent type of product sold. Each slip contains: 

a) The salesperson number. 

b) The product number. 

c) The number of that product sold that day. 

Thus, each salesperson passes in between 0 and 5 sales slips per day. Assume that the information 
from all of the slips for last month is available. Write a program that will read all this information for 
last month’s sales and summarize the total sales by salesperson by product. All totals should be 
stored in list sales. After processing all the information for last month, display the results in tabu- 
lar format, with each of the columns representing a particular salesperson and each of the rows rep- 
resenting a particular product. Cross-total each row to get the total sales of each product for last 
month; cross-total each column to get the total sales by salesperson for last month. Your tabular 
printout should include these cross-totals to the right of the totaled rows and at the bottom of the 
totaled columns. 
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5.5 (The Sieve of Eratosthenes) A prime integer is any integer greater than 1 that is evenly divis- 
ible only by itself and 1. The Sieve of Eratosthenes is a method of finding prime numbers. It operates 
as follows: 

a) Create a list with all elements initialized to 1 (true). List elements with prime subscripts 
will remain 1. All other list elements will eventually be set to zero. 

b) Starting with list element 2, every time a list element is found whose value is 1, loop 
through the remainder of the list and set to zero every element whose subscript is a mul¬ 
tiple of the subscript for the element with value 1. For list subscript 2, all elements be- 
yond 2 in the list that are multiples of 2 will be set to zero (subscripts 4, 6, 8, 10, etc.); 
for list subscript 3, all elements beyond 3 in the list that are multiples of 3 will be set to 
zero (subscripts 6, 9, 12, 15, etc.); and so on. 

When this process is complete, the list elements that are stili set to 1 indicate that the subscript is a 
prime number. These subscripts can then be printed. Write a program that uses a list of 1000 ele¬ 
ments to determine and print the prime numbers between 2 and 999. Ignore element 0 of the list. 

5.6 (Bubble Sort) Sorting data (i.e. placing data into some particular order, such as ascending or 
descending) is one of the most important computing applications. Python lists provide a sort meth¬ 
od. In this exercise, readers implement their own sorting function, using the bubble-sort method. In 
the bubble sort (or sinking sort), the smaller values gradually “bubble” their way upward to the top of 
the list like air bubbles rising in water, while the larger values sink to the bottom of the list. The pro¬ 
cess that compares each adjacent pair of elements in a list in turn and swaps the elements if the second 
element is less than the first element is called a pass. The technique makes several passes through the 
list. On each pass, successive pairs of elements are compared. If a pair is in increasing order, bubble 
sort leaves the values as they are. If a pair is in decreasing order, their values are swapped in the list. 
After the first pass, the largest value is guaranteed to sink to the highest index of a list. After the sec¬ 
ond pass, the second largest value is guaranteed to sink to the second highest index of a list, and so 
on. Write a program that uses function bubbleSort to sort the items in a list. 

5.7 (Binary Search) When a list is sorted, a high-speed binary search technique can find items in 
the list quickly. The binary search algorithm eliminates from consideration one-half of the elements 
in the list being searched after each comparison. The algorithm locates the middle element of the list 
and compares it with the search key. If they are equal, the search key is found, and the subscript of 
that element is retumed. Otherwise, the problem is reduced to searching one half of the list. If the 
search key is less than the middle element of the list, the first half of the list is searched. If the search 
key is not the middle element in the specified piece of the original list, the algorithm is repeated on 
one-quarter of the original list. The search continues until the search key is equal to the middle ele¬ 
ment of the smaller list or until the smaller list consists of one element that is not equal to the search 
key (i.e. the search key is not found.) 

Even in a worst-case scenario, searching a list of 1024 elements will take only 10 comparisons 
during a binary search. Repeatedly dividing 1024 by 2 (because after each comparison we are able to 
eliminate from the consideration half the list) yields the values 512, 256, 128, 64, 32, 16, 8, 4. 2 and 1. 
The number 1024 (210) is divided by 2 only ten times to get the value 1. Dividing by 2 is equivalent to 
one comparison in the binary-search algorithm. A list of 1,048.576 (2 20 ) elements takes a maximum of 
20 comparisons to find the key. A list of one billion elements takes a maximum of 30 comparisons to 
fmd the key. The maximum number of comparisons needed for the binary search of any sorted list can 
be determined by finding the first power of 2 greater than or equal to the number of elements in the list. 

Write a program that implements function binarySearch, which takes a sorted list and a 
search key as arguments. The function should return the index of the list value that matches the 
search key (or -1, if the search key is not found). 

5.8 Create a dictionary of 20 random values in the range 1-99. Determine whether there are any 
duplicate values in the dictionary. (Hint: you many want to sort the list first.) 
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Objectives 

• To understand the Common Gateway Interface (CGI) 
protocol. 

• To understand the Hypertext Transfer Protocol 
(HTTP). 

• To implement CGI Scripts. 

• To use XHTML forms to send information to CGI 
Scripts. 

• To understand and parse query strings. 

• To use module egi to process information from 
XHTML forms. 

This is the common air that bathes the globe. 

Wait Whitman 

The longestpart ofthe joumey is said to be the passing ofthe 
gate. 

Marcus Terentius Varro 

Railway termini...are our gates to the glorious and unknown. 
Through them we pass out into adventure and sunshine, to 
them, alas! we return. 

E. M. Forster 

There comes a time in a man ’s life when to get where he has 
to go—ifthere are no doors or Windows—he walks through 
a wall. 

Bernard Malamud 



m 


-s* 


rm 
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O uti i ne 

6.1 Introduction 

6.2 Clientand Web Serverlnteraction 

6.2.1 System Archrbecture 

6.2.2 Accessing Web Servets 

6.2.3 HTIPTransactions 

6.3 Simple CGI Script 

6.4 Sending Inputto a CGI Script 

6.5 Using XKlMLFormsto Send Inputand Using Module egi to Retrieve 
Forni Data 

6.6 Using egi . FieldStorage to Read Input 

6.7 Other HTTP Hea deis 

6.8 Example: Interactive PortaI 

6.9 Internet and World Wide Web Resources 

Summary • Tenninology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 


6.1 Introduction 

The Common Gateway Interface (CGI) describes a set of protocols through which appli¬ 
catioris (commonly called CGI programs or CGI scripts) interact with Web servers and 
indirectly with Web browsers (e.g., client applications). A Web server is a specialized 
Software application that responds to client application requests by providing resources 
(e.g. Web pages). CGI protocols often generate Web content dynamically. A Web page is 
dynamic if a program on the Web server generates that page’s content each time a user 
requests the page. For example, a form in a Web page could request that a user enter a zip 
code. When the user types and submits the zip code, the Web server can use a CGI pro¬ 
gram to create a page that displays information about the weather in that client’s region. 
In contrast, static Web page content never changes unless the Web developers edit the doc- 
ument. 

CGI is “common” because it is not specific to any operating system (e.g., Linux or 
Windows), to any programming language or to any Web server Software. CGI can be used 
with virtually any programming or scripting language, such as C, Perl and Python. In this 
chapter, we explain how Web clients and servers interact. We introduce the basies of CGI 
and use Python to write CGI scripts. 

The CGI protocol was developed in 1993 by the National Centerfor Supercomputing 
Applications ( NCSA — www.ncsa.uiuc.edu), for use with its HTTPd Web server. 
NCSA developed CGI to be a simple tool to produce dynamic Web content. The simplicity 
of CGI resulted in its widespread use and in its adoption as an unofficial worldwide pro¬ 
tocol. CGI was quickly incorporated into additional Web servers, such as Microsoft 
Internet Information Services (IIS) and Apache (www. apache . org). 
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6.2 C lient and Web Server Interaction 

In this section, we discuss the interactions between a Web server and a client application. 
A Web page, in its simplest form, is either a Hypertext Markup Language {HTML) docu- 
ment or an Extensible Hypertext Markup Language (XHTML) document. (In this chapter, 
we use XHTML. ) An XHTML document is a plain-text file that contains markup, or tags , 
which describe how the document should be displayed by a Web browser. For example, the 
XHTML markup 

<title>My Web Page</title> 

indicates that the text between the opening <ti tle> tag and the closing </ ti tle> tag is 
the Web page’s title. The browser renders the text between these tags in a speciftc manner. 

XHTML requires syntactically correct documents—markup must follow speciftc rules. 
For example, XHTML tags must be in all lowercase letters and all opening tags must have 
corresponding closing tags. We discuss XHTML in detail in Appendix I and Appendix J. 

Each Web page has a unique Uniform Resource Locator {URL) associated with it—an 
address of sorts. The URL contains information that directs a browser to the resource (most 
often a Web page) the user wishes to access. For example, consider the URL 

http://www.deitel.com/books/downloads.html 

The first part of the address, http : //, indicates that the resource is to be obtained using 
the Hypertext Transfer Protocol (HTTP). During this interaction, the Web server and the 
client communicate using the platform-independent HTTP, a protocol for transferring re- 
quests and files over the Internet (e.g., between Web servers and Web browsers). 
Section 6.2.3 discusses HTTP. 

The next section of the URL— www. deitel . com —is the hostname of the server, 
which is the name of the server computer, the host , on which the resource resides. A domain 
name system (DNS) server translates the hostname (www. deitel. com) into an Internet 
Protocol (IP) address (e.g., 207.60.134.230) that identifies the server computer (just 
as a telephone number uniquely identifies a particular phone line). This translation opera- 
tion is a DNS lookup. A DNS server maintains a database of hostnames and their corre¬ 
sponding IP addresses. 

The remainder of the URL speciftes the requested resource— /books/down- 
loads.html. This portion of the URL speciftes both the name of the resource (down- 
loads.html —an HTML/XHTML document) and its path (/books). The Web server 
maps the URL to a file (or other resource, such as a CGI program) on the server, or to another 
resource on the server’s network. The Web server then returns the requested document to the 
client. The path represents a directory in the Web server’s file system. It also is possible that 
the resource is created dynamically and does not reside any where on the server computer. In 
this case, the URL uses the hostname to locate the correct server, and the server uses the path 
and resource information to locate (or create) the resource to respond to the client’s request. 
As we will see, URLs also can provide input to a CGI program residing on a server. 

6.2.1 System Architectura 

A Web server often is part of a multi-tier application. sometimes referred to as an n-tier 
application. Multi-tier applications divide functionality into separate tiers (i.e., logical 
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groupings of functionality). Tiers can be located on a single computer or on multiple com- 
puters. Figure 6.1 presents the basic structure of a three-tier application. 

The information tier (also called the data tier or the bottom tier ) maintains data for the 
application. This tier typically Stores data in a relational database management system 
(RDBMS). We discuss relational database management systems in further detail in 
Chapter 17, Database Application Programming Interface (DB-API). For example, a retail 
store may have a database for product information, such as descriptions, prices and quan- 
tities in stock. The same database also may contain customer information, such as user 
names, billing addresses and credit-card numbers. 

The middle tier implements business logic and presentation logic to control interac- 
tions between application clients and application data. The middle tier acts as an interme- 
diary between data in the information tier and the application clients. The middle-tier 
controller logic processes client requests from the client tier (e.g., a request to view a 
product catalog) and retrieves data from the database. The middle-tier presentation logic 
then processes data from the information tier and presents the content to the client. 

Business logic in the middle tier enforces business ride s and ensures that data are reli- 
able before updating the database or presenting data to a client. Business rules dictate how 
clients can and cannot access application data and how applications process data. 

The middle tier also implements the application’s presentation logic. Web applications 
typically present information to clients as XHTML documents (older applications present 
information as F1TML). Many Web applications present information to wireless clients as 
Wireless Markup Language (WML) documents. We discuss WML in detail in Chapter 23, 
Case Study: Online Bookstore. 

The client tier , or top tier , is the application’s user interface. Users interact with the 
application through the user interface. This causes the client to interact with the middle tier 
to make requests and to retrieve data from the information tier. The client then displays to 
the user the data retrieved from the middle tier. 

6.2.2 Accessing V\feb Servers 

To request documents from Web servers, users must know the machine names (called host- 
names) on which Web server Software resides. Users can request documents from local 
Web servers (i.e, those that reside on users’ machines) or remote Web servers (i.e., those 
that reside on different machines). 


Client Tier Middle Tier 

Application 



Information Tier 



Database 


Fig. 6.1 Three-tierapplication model. 
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We can request document from local Web servers through the machine name or 
through localhost —a hostname that references the local machine. We use local- 
host in this book. To determine the machine name in Windows 98, right-click NetWork 
Neighborhood, and select Properties from the context menu to display the NetWork 
dialog. In the NetWork dialog, click the Identification tab. The computer name displays 
in the Computer name: field. Click Cancel to close the NetWork dialog. In Windows 
2000, right click My NetWork Places and select Properties from the context menu to 
display the NetWork and Dialup Connections explorer. In the explorer, click Net¬ 
Work Identification. The Full Computer Name: field in the System Properties 
window displays the computer name. To determine the machine name on most Linux 
machines, simply type the command hostname at a shell prompt. 

A client also can access a server by specifying the server’ s domain name or IP address 
(e.g., in a Web browser’s Address field). A domain name represents a group of hosts on 
the Internet; it combines with a hostname (such as www —a common hostname for Web 
servers) and a top-level domain (TLD) to form a fully qualified hostname , which provides 
a user-friendly way to identify a site on the Internet. In a fully qualified hostname, the TLD 
often describes the type of organization that owns the domain name. For example, the com 
TLD usually refers to a commercial business, whereas the org TLD usually refers to a non- 
profit organization. In addition, each country has its own TLD, such as cn for China, et 
for Ethiopia, om for Oman and us for the United States. 

6.2.3 HTTPTransactions 

Before exploring how CGI operates, it is necessary to have a basic understanding of net- 
working and the World Wide Web. In this section, we discuss the technical aspects of how 
a browser interacts with a Web server to display a Web page and we examine the Hypertext 
Transfer Protocol (HTTP). We also explore HTTP’s components that enable clients and 
servers to internet and exchange information uniformly and predictably. 

An HTTP request often posts data to a server-sideform handler that processes the data. 
For example, when a user participates in a Web-based survey, the Web server receives the 
information specified in the XHTML form as part of the request. 

When a user enters a URL, the client has to request that resource. The two most 
common HTTP request types (also known as request methods ) are get and post. These 
request types retrieve resources from a Web server and send client form data to a Web 
server. A get request sends form content as part of the URL. For example, in the URL 

www .somesite . com/search?query=va/«e 

the information following the ? (query=va/ue) indicates the user-specified input. For ex¬ 
ample, if the user performs a search on “Massachusetts,” the last part of the URL would be 
?query=Massachusetts. Most Web servers limit get request query strings to 1024 
characters. If the query string exceeds this limit, the post request must be used. The data 
sent in a post request is not part of the URL and cannot be seen by the user. Forms that con- 
tain many ftelds are submitted most often by post requests. Sensitive form fields, such as 
passwords, usually are sent using this request type. 

To make the request, the browser sends an HTTP request message to the server (step 
1, Fig. 6.2). HTTP has two request types, get and post. The get request (in its simplest form) 
follows the format: GET /books/downloads . html HTTP/1.1. The word GET is an 
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Web server 



; 1 ;The Client sends 
the get request 
to the Web server. 


( 2 , Atterit receivesthe 
request, the Web server 
searchesthrough its 
system forthe resource. 


Fig.6.2 Client interacting with serverand Web server. Step 1: The request, GET 

/books/downloads.html HTTP/1.1. 




Web server 



The server responds to 
the request with an 
appropriate message, 
along with the resource 
contents. 


Fig. 6.2 Client interacting with serverand Web server. Step 2: The HTTP response, 
HTTP/1.1 200 OK. 

HTTP method indicating that the client is requesting a resource. The next part of the request 
provides the name (downloads . html) and path (/books/) of the resource (an HTML/ 
XHTML document). The final part of the request provides the protocoFs name and version 
number (HTTP/1.1). 

Servers that understand HTTP version 1.1 translate this request and respond (step 2, 
Fig. 6.2). The server responds with a line indicating the HTTP version, followed by a status 
code that consists of a numeric code and phrase describing the status of the transaction. For 
example, 

HTTP/1.1 200 OK 
indicates success, while 

HTTP/1.1 404 Not found 

informs the client that the requested resource was not found on the server in the location 
specified by the URL. 

Browsers often cache (save on a local disk) Web pages for quick reloading, to reduce 
the amount of data that the browser needs to download. However, browsers typically do not 
cache server responses to post requests, because subsequent post requests may not contain 
the same information. For example, several users who participate in a Web-based survey 
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may request the same Web page. Each user’s response changes the overall results of the 
survey, thus the data on the Web server is changed. 

On the other hand, Web browsers cache server responses to get requests. With a Web- 
based search engine, a get request normally supplies the search engine with search criteria 
specifted in an XHTML form. The search engine then performs the search and retums the 
results as a Web page. These pages are cached in the event that the user performs the same 
search again. 

The server normally sends one or more HTTP headers, which provide additional infor- 
mation about the data sent in response to the request. In this case, the server is sending an 
HTML/XHTML text document, so the HTTP header reads 

Content-type: text/html 

This information is known as the MIME (Multipurpose Internet Mail Extensions) type of 
the content. MIME is an Internet Standard that speciftes how messages should be formatted 
and clients use the content type to determine how to represent the content to the user. Each 
type of data sent has a MIME type associated with it that helps the browser determine how 
to process the data it receives. For example, the MIME type text/plain indicates that 
the data is text that should be displayed without attempting to interpret any of the content 
as HTML or XHTML markup. Similarly, the MIME type image/gif indicates that the 
content is a GIF (Graphics Interchange Format) image. When this MIME type is received 
by the browser, it attempts to display the image. For more information on MIME, visit 

www.nacs.uci.edu/indiv/ehood/MIME/MIME.html 

The header (or set of headers) is followed by a blank line (a carriage return, line feed or 
combination of both) which indicates to the client that the server is ftnished sending HTTP 
headers. The server then sends the text in the requested HTML/XHTML document (down- 
loads . html). The connection terminates when the transfer of the resource completes. The 
client-side browser interprets the text it receives and displays (or renders) the results. 

This section examined how a simple HTTP transaction is performed between a Web- 
browser application on the client side (e.g., Microsoft Internet Explorer or Netscape Com¬ 
municator) and a Web-server application on the server side (e.g., Apache or IIS). Next, we 
introduce CGI programming. 

6.3 Simple CGI Script 

Two types of scripting are used in Web-based applications: server-side and client-side. CGI 
Scripts are an example of server-side Scripts because they run on the server. Programmers 
have greater control over Web page content when using server-side Scripts, because server- 
side Scripts can manipulate databases and other server resources. An example of client-side 
scripting is JavaScript. Client-side Scripts can access the browser’s features, manipulate 
browser documents, validate user input and much more. 

Scripts executed on the server usually generate custom responses for clients. For 
example, a client might connect to an airline’s Web server and request a list of ali flights 
from Boston to San Antonio between September 19th and November 5th. The server que- 
ries the database, dynamically generates XHTML content containing the flight list and 
sends the XHTML to the client. This technology allows clients to obtain the most current 
flight information from the database by connecting to an airline’s Web server. 
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Server-side scripting languages have a wider range of programmatic capabilities than 
their client-side equivalents. For example, server-side Scripts can access the server’s file 
directory structure, whereas client-side Scripts cannot access the client’s file directory 
structure. 

Server-side Scripts also have access to server-side Software that extends server func- 
tionality. These pieces of Software are called COM components for Microsoft Web servers 
and modules for Apache Web servers. Components and modules range from programming 
language support to counting the number of times a Web page has been visited (known as 
the number of hits). 



Server-side Scripts are not visible to the client; only the content the server delivers is visible 
to the client. 


As long as a file on the server remains unchanged, its associated URL will display the 
same content in clients’ browsers each time the file is accessed. For the content in the file 
to change (e.g., to include new links or the latest company news), someone must alter the 
file manually (probably with a text editor or Web-page design Software) then load the 
changed file back onto the server. 

Manually changing Web pages is not feasible for those who want to create interesting 
and dynamic Web pages. For example, if you want your Web page always to display the 
current date or weather, the page would require continuous updating. 

The examples in this chapter rely heavily upon XF1TML and Cascading Style Sheets 
(CSS). CSS allows document authors to specify the presentation of elements on a Web page 
(spacing, margins, etc.) separately from the structure of the document (section headers, 
body text, links, etc.). Readers not familiar with these technologies will want to read 
Appendix I and Appendix J, which describe XF1TML in detail and Appendix K, Cascading 
Style Sheets, which introduces CSS. 

Figure 6.3 illustrates the full program listing for our first CGI script. Line 1 


#!c: \Python\python .exe 

is a directive (sometimes called the pound-bang or sh-bang ) that specifies the location of 
the Python interpreter on the server. This directive must be the first line in a CGI script. The 
examples in this chapter are for Window users. For UNIX or Linux-based machines, the 
directive typically is one of the following: 


#!/usr/bin/python 
#!/usr/local/bin/python 
#!/usr/bin/env python 


depending on the location of the Python interpreter. [Note: If you do not know where the 
Python interpreter resides, contact the server administrator.] 


Common Programming Error 6.1 



Forgetting to put the directive (#!) in the first line ofa CGI script is an error ifthe Web serv¬ 
er running the script does not understand the . pyfilename extensiori. 


Line 5 imports module time. This module obtains the current time on the Web 
server and displays it in the user’s browser. Lines 7-17 deline function printHeader. 
This function takes argument title, which corresponds to the title of the Web page. Line 
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#!c: \Python\python .exe 

# Fig. 6.3: fig06_03.py 

# Displays current date and time in Web browser. 
import time 

def printHeader( title ): 

print .'Content-type: text/html 


% title 

printHeader( ) 

print time.ctime( time.time() ) 

print "</bodyx/html>" 




3 Current date and time - Microsoft Internet Explorer 

jnjxj 

File Edit View Favorites Tools Help 


o 

"r* Back t (21 [$?| | ^Search 

[*j Favorites 

» 

Address |<£] http://localho$t/cgi-bin/fig06 03.py 

zi ^ Go 

Links » 

Tue Oct 30 12:16:07 2001 


d 



d 

£] Done 

(f[r Local intranet 

//. 


Fig. 6.3 CGI scriptdisplaying the date and time. 


8 prints the HTTP header. Notice that line 9 is blank, which denotes the end of the HTTP 
headers. The line that follows the last HTTP header must be a blank line, otherwise Web 
browsers cannot render the content properly. Lines 10-14 print the XML declaration, doc- 
ument type declaration and opening <html> tag. For more information on XML, see 
Chapter 15. Lines 15-17 contain the XHTML document header and title and begin the 
XHTML document body. 



Common Programming Error 6.2 


Failure to place a blank line after an HTTP header is an error. 


Line 19 begins the main portion of the program by calling function printHeader 
and passing an argument that represents the title of the Web page. Line 20 calls two func- 
tions in module time to print the current time. Function time, time returns a floating- 
point value that represents the number of seconds since midnight, January 1, 1970 (called 
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the epoch). Function time. ctime takes as an argument the number of seconds since the 
epoch and returns a human-readable string that represents the current time. We conclude 
the program by printing the XHTML body and document closing tags. For a complete list 
of functions in module time, visit 

www.python.org/doc/current/1ib/module-time.html 

Note that the program consists almost entirely of print statements. Until now, the 
output of print has always displayed on the screen. However, technically speaking, the 
default target for print is Standard output — an information stream presented to the user 
by an application. Typically, Standard output is displayed on the screen, but it may be sent 
to a printer, written to a file, etc. When a Python program executes as a CGI script, the 
server redirects the Standard output to the client Web browser. The browser interprets the 
headers and tags as if they were part of a normal server response to an XHTML document 
request. 

Executing the program requires a properly configured server. [Note: In this book, we 
use the Apache Web server. For information on obtaining and configuring Apache, refer to 
our Python Web resources at www. deitel. com.] Once a server is available, the Web 
server site administrator specifies where CGI Scripts can reside and what names are allowed 
for them. In our example, we place the Python file in the Web server’s egi -bin directory. 
For UNIX and Linux users, it also is necessary to set the permissions before executing the 
program. For example, UNIX and Linux command 

chmod 755 fig06_02.py 

gives the client the permission to read and exeeute f ig06_02 .py. 

Assuming that the server is on the local computer, exeeute the program by typing 

http://localhost/egi-bin/fig06_02.py 

in the browser’s Address or Location field. If the server resides on a different computer, 
replace localhost with the server’s hostname or IP address. [Note: The IP address of 
localhost is always 127.0.0.1.] Requesting the document causes the server to exe¬ 
eute the program and return the results. 

Figure 6.4 illustrates the process of calling a CGI script. First, the client requests the 
resource named fig06_02.py from the server, just as the client requested down- 
loads .html in the previous example (Step 1). If the server has not been configured to 
handle CGI Scripts, it might return the Python code as text to the client. 

A properly configured Web server, however, recognizes that certain resources need to 
be processed differently. For example, when the resource is a CGI script, the script must be 
exeeuted by the Web server. A resource usually is designated as a CGI script in one of two 
ways—either it has a special filename extension (such as . egi or . py), or it is located in 
a specific directory (often egi-bin). In addition, the server administrator must grant 
explicit permission for remote access and CGI-script exeeution. 

The server recognizes that the resource is a Python script and invokes Python to exe¬ 
eute the script (Step 2). The program executes, and the text sent to Standard output is 
returned to the Web server (Step 3). Finally, the Web server prints an additional line to the 
output that indicates the status of the HTTP transaction (such as HTTP/1.1 200 OK, for 
success) and sends the whole body of text to the client (Step 4). 
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(T) The get request is sent 
from the Client to the 
Web server. 


(2) After it receives the 
request, the Web 
server searches 
through its system of 
resources. 


Fig. 6.4 Step 1: The GET request, GET /cgi-bin/fig06_02 .py HTTP/ 
l.l.(Partlof4.) 





The CGI script isrun.creating 
the outputto be sent backto 
the Client. 


Fig. 6.4 Step 2: The Web server sta rts the CGI script. (Part 2 of 4.) 



The output produced from 
the script issent backto the 
Web server 








Fig. 6.4 Step 3: The output of the script issent to the Web server. (Part 3 of 4.) 
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The serverrespondsto the 
request with an appropriate 
message along with the 
resultsofthe CGI script. 


Fig. 6.4 Step 4: The HTTP response, HTTP/1.1 200 OK. (Part4 of 4.) 

The browser on the client side then processes the XHTML output and displays the 
results. It is important to note that the browser does not know about the work the server has 
done to execute the CGI script and return XHTML output. As far as the browser is con- 
cerned, it is requesting a resource like any other and receiving a response like any other. 
The client computer is not required to have a Python interpreter installed, because the script 
executes on the server. The client simply receives and processes the script’s output. 

We now consider a more involved CGIprogram. Figure 6.5 organizes all CGI environ¬ 
ment variables and their corresponding values in an XHTML table, which is then displayed 
in a Web browser. Environment variables contain information about the execution environ- 
ment in which script is being run. Such information includes the current user name and the 
name of the operating system. A CGI program uses environment variables to obtain infor¬ 
mation about the client (e.g., the client’s IP address, operating system type, browser type, 
etc.) or to obtain information passed from the client to the CGI program. 

Line 6 imports module egi. This module provides several CGI-related capabilities, 
including text-formatting, form-processing and URL parsing. In this example, we use 
module egi to format XHTML text; in later examples, we use module egi to process 
XHTML forms. 
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#!c: \Python\python .exe 

# Fig. 6.5: fig06_05.py 

# Program displaying CGI environment variables. 

import os 
import egi 

def printHeader( title ): 

print """Content-type: text/html 


Fig. 6.5 CGI program to disp Ia y environment variables. (Part 1 of 2.) 
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% title 


rowNumber = 
backgroundColor = 

printHeader( ) 

print """<table style = "border: 

# print table of egi variables and values 

for item in os.environ.keys(): 
rowNumber += 


if rowNumber % == 

backgroundColor = 

else : 

backgroundColor = 


# even row numbers are white 

# odd row numbers are grey 


print 

cgi.escape( item 


% ( backgroundColor, 

, cgi.escape( os.environ[ item ] ) ) 


print 


3 Environment Variables - Microsoft Internet Explorer 


.Jfll x| 


File Edit View Favorites 

Tools 

Help 


] v^Back * ’ <Q 

tai 

t^Search f^jFavorites (^History jwj ■* jj 


Address ||r] http://localhost/cgi-bin/fig06 05.py i^Go 

REMOTE_ADDR 


127.0.0.1 


SERVER_NAME 


arj.deitel.com 


HTIPJ30NNECIION 


Keep-Alive 


HTTP_USER_AGENT 


Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) 


"WINDIR 


CVWINNT 


HTTP_ACCEPT 


image/gif, image/x-xbitmap, image/jpeg, image/pjpeg, 
application/vnd.ms-excel, application/msword, application/pdf, */* 


REQUEST URI 


/ cgi-bin/figO 6_0 5. py 


SYS1EMROOT 


C:\WUSTNT 


QUERY_STRING 

SERVER_PROTOCOL 


HTTP/1.1 


HTXP_HOST 


localhost 


REQUEST_METHOD 


GET 


SERVER SIGNATURE 


<ADDKESS>Apache/1.3.20 Server at arj.deitel.comPort 

zl 

££] Done 


jpr Local intranet 

st 


Fig. 6.5 CGI program to disp Ia y environment variables. (Part 2 of 2.) 

Lines 8-18 define function printHeader, which is identical to the function we 
defined in the previous example. The main program prints an XHTML table that contains 
the environment variables (lines 24—39). The os. environ data member holds ali the 
environment variables (line 27). This data member acts like a dictionary; therefore, we can 
access its keys via the keys method and its values via the [ ] operator. Lines 30-33 set the 
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background color for each row. For each environment variable, lines 35-37 create a new 
row in the table containing that key and the corresponding value. 

Note that line 37 calls function egi . escape and passes as values each environment 
variable name and value. This function takes a string and returns a properly formatted 
XHTML string. Proper formatting means that special XHTML characters, such as the less- 
than and greater-than signs (< and >), are “escaped.” For example, function escape 
returns a string where “<” is replaced by “&lt;”, “>” is replaced by and is 

replaced by “&amp;”. The replacement signifies that the browser should display a char¬ 
acter instead of treating the character as markup. After we have printed all the environment 
variables, we close the table, body and html tags (line 39). 

6.4 Sending Inputto a CGI Script 

You have seen one example of a CGI script processing preset environment variables. We now 
use an environment variable to supply data (e.g., client’s name, search-engine query, etc.) to 
a CGI script. This section presents the environment variable QUERY_STRING that provides 
such a mechanism. The QUERY_STRING variable contains extra information that is append- 
ed to a URL in a GET request, following a question mark (?). For example, the URL 

www .somesite . com/egi -bin/script. py?state=Calif orni a 

causes the Web browser to request a resource from www . somesite . com. The resource uses 
a CGI script (egi-bin/script .py) to exeeute. The information following the ? 
(state=California) is assigned by the Web server to the QUERY_STRING environ¬ 
ment variable. Note that the question mark is not part of the resource requested, nor is it 
part of the query string; it serves as a delimiter (or separator) between the resource and the 
query string. 

Figure 6.6 shows a simple example of a CGI script that reads and responds to data 
passed through the QUERY_STRING environment variable. The CGI script reading the 
string needs to know how to interpret the formatted data. In the example, the query string 
contains a series of name-value pairs separated by ampersands (&), as in 

country=USA&state=California&city=Sacramento 

Each name-value pair consists of a name (e.g., country) and a value (e.g., USA), delim- 
ited by an equal sign. 

In line 24 of Fig. 6.6, we assign the value of environment-variable QUERY_STRING 
to variable query. Line 26 then tests to determine whether query is empty. If so, a mes- 
sage prints instructing the user to add a query string to the URL. We also provide a link to 
a URL that includes a sample query string. Note that query-string data may also be speci- 
fied as part of a hypertext link in a Web page. 


1 #!c: \Python\python .exe 

2 # Fig. 6.6: fig06_06.py 

3 # Example using QUERY STRING. 

4 

5 import os 

6 import egi 


Fig. 6.6 Reading inputfrom QUERY_STRING. (Part 1 of 3.) 
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def printHeader( title ): 
print """Content-type: 


% title 

printHeader( ) 

print "<hl>Name/Value Pairs</hl>" 

query = os.environl ] 

if len( query ) == : 

print ""<pxbr /> 


else : 

print """<p style = "font-style: 

pairs = egi.parse_qs( query ) 

for key, value in pairs.items(): 

print "<p>You set '%s' to vali 

( key, value ) 


% cgi.escape( query ) 


print 







Fig.6.6 Reading inputfrom QUERY_STRING. (Part 2 of 3.) 
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1 3j QUERY STRING example - Microsoft Internet Explorer 

dsld 

File Edit View Favorites Tools Help 

mm 

-4-j Back » ^ ^J^Search Favorites 

r ^History ” 

Address |^] http: //localhost/cgi-bin/fig06 06. py?name=Veronicafkage= 

=23 if^Go 

Name/Value Pairs 


The query string is 'name = Veronica&age=23'. 


You set 'age' to value ['23'] 


You set 'name' to value ['Veronica'] 

d 

£] Done 

Local intranet 


3 QUERYSTRING example - Microsoft Internet Explorer 


File Edit View Favorites Tools Help 


.JSJxJ 


Back ▼ Q i^Search Favorites ^jjHistory 


Address | http: //localhost/cgi-bin/fig06 06. py?name=Archibald&age=2 


73 ^ Go 


Name/Value Pairs 

The query stnng is 'name=Archibald&age=2'. 
You set 'age' to value ['2'] 

You set 'name' to value ['Archibald'] 


d 


Done 


TT1 


Fig.6.6 Reading inputfrom QUERY_STRING. (Part 3 of 3.) 

If the query string is not empty, the value of the query string (lines 31-32) prints. Func- 
tion egi.parseqs parses (i.e., “splits-up”) the query string (line 33). This function 
takes as an argument a query string and returns a dictionary of name-value pairs contained 
in the query string. Lines 35-37 contain a for loop to print the names and values contained 
in dictionary pairs. 

6.5 lising XHTMLFbimsto Send Input and lising Module egi to 
Retrieve Form Data 

If Web page users had to type ali the information that the page required into the page’s URL 
every time the user wanted to access the page, Web surfing would be quite a laborious task. 
XHTML provides fornis on Web pages that provide a more intuitive way for users to input 
information to CGI Scripts. 

The <form> and </form> tcigs surround an XHTML form. The <form> tag typi- 
cally takes two attributes. The first attribute is action, which specifies the operation to 
perform when the user submits the form. For our purposes, the operation usually will be to 
call a CGI script to process the form data. The second attribute is method, which is either 
get or post. In this section, we show examples using both methods. An XHTML form may 
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contain any number of elements. Figure 6.7 gives a brief description of severat possible ele- 
ments to include. 

Figure 6.8 demonstrates a basic XHTML form that uses the HTTP get method. Lines 
21-26 output the form. Notice that the method attribute is get and the action attribute 
is fig0 6_0 8 .py (i.e., the script calls itself to handle the form data once they are sub- 
mitted—this is called a postback). 

The form contains two input fields. The first is a single-line text field (type = 
"text") with the name word (line 23). The second displays a button, labeled Submit 
word, to submit the form data (line 24). 

The first time the script executes, QUERY_STRING should contain no value (unless 
the user has specifically appended a query string to the URL). However, once the user 
enters a word into the word text field and clicks the Submit word button, the script is 
called again. This time, the QUERY_STRING environment variable contains the name of 
the text-input field (word) and the user-entered value. For example, if the user enters the 
word python and clicks the Submit word button, QUERY_STRING would contain the 
value "word=python". 


lag name 

type attribute 
(for < input > tags) 

Description 

<input> 

button 

A Standard push button. 


checkbox 

Displays a checkbox that can be checked (true) or 
unchecked (false). 


file 

Displays a text field and button so the user can specify a 
file to upload to a Web server. The button displays a file 
dialog that allows the user to select a file. 


hidden 

Hides data infomiation from clients so that hidden form 
data can be used only by the form handler on the server. 


image 

The same as submit, but displays an image rather 
than a button. 


password 

Like text, but each character typed appears as an 
asterisk (*) to hide the input (for security). 


radio 

Radio buttons are similar to checkboxes, except that 
only one radio button in a group of radio buttons can be 
selected at a time. 


reset 

A button that resets form fields to their default values. 


submit 

A push button that submits form data according to the 
fomfs action. 


text 

Provides single-line text field for text input. This 
attribute is the default input type. 

<select> 


Drop-down menu or selection box. When used with the 
<option> tag, <select> specifies items to select. 

<textarea> 


Multiline area in which text can be input or displayed. 


Fig. 6.7 XHTMLform elements. 
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1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 


#!c: \Python\python .exe 

# Fig. 6.8: fig06_08.py 

# Demonstrates get method with an XHTML form. 
import egi 

def printHeader( title ): 

print .'Content-type: text/html 


% title 


printHeader( ) 

print 11 " 11 <p>Enter one of your favorite 


pairs = cgi.parseO 

if pairs.has_key( ): 

print , '"<p>Your word is 

% cgi.escape( pairs [ ] [ ] ) 

print "</bodyx/html>" 



\ 









Fig. 6.8 get used with an XHTMLform. (Part 1 of 2.) 
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Fig. 6.8 get used with an XHTMLform. (Part 2 of 2.. 




Line 28 uses function egi .parse to parse the form data. This function is similar to 
function egi .parse_qs, except that egi .parse parses the data from Standard input 
(as opposed to the query string) and returns the name-value pairs in a dictionary. 

Thus, during the second exeeution of the script, when the query string is parsed, line 
28 assigns the returned dictionary to variable pairs. If dictionary pairs contains the key 
"word", the user has submitted at least one word and the program prints the word(s) to the 
browser. The words are passed to function egi . escape in case the input includes some 
special characters (such as <, > or a space). Lines 31-33 use CSS to display the resuit. CSS 
is discussed in Appendix K, Cascading Style Sheets (CSS). In Fig. 6.8, we see that the 
spaces in the address bar are replace by plus signs because Web browsers URL-encode 
XHTML-form data they send, which means that spaces are turned into plus signs and that 
certain other symbols (such as the apostrophe) are translated into their ASCII value in hexa- 
decimal and preceded with a percent sign. 

Using get with an XHTML form passes data to the CGI script in the same way that we 
saw in Fig. 6.6—through environment variables. Another way that CGI Scripts interact 
with servers is via Standard input and the post method. For comparison purposes, let us now 
reimplement the application of Fig. 6.8 using post. Notice that the code in the two figures 
is virtually identical. The XHTML form indicates that we are now using the post method 
to submit the form data (line 21). 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 


#!c: \Python\python .exe 

# Fig. 6.9: fig06_09.py 

# Demonstrates post method with an XHTML form. 
import egi 

def printHeader( title ): 

print """Content-type: text/html 






Fig. 6.9 post used with an XHTMLform. (Part 1 of 2.) 
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14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 


% title 

printHeader( ) 

print " ,M, <p>Enter one of your favorite w 


pairs = cgi.parseO 

if pairs.has_key( ): 

print ” ‘<p>Your word is 

% cgi.escape( pairs[ ] [ ] ) 

print "</bodyx/html>" 


\ 



jdfll x| 

File Edit View Favorites Tools Help 

m 

] -J-iBack ’ ^ 2t Search 

Address |^] http://localhost/cgi-bin/fig06 09.py 

zl ^ Go 

Enter one of your favorite words here: 

-d 

Submitword | 

Your word is: technology 

id 

£] Do ne gjr Local intranet 



Fig. 6.9 post used with an XHTNILform. (Part 2 of 2.) 

The post method sends data to a CGI script via Standard input. The data are encoded 
just as in QUERY_STRING (that is, with name-value pairs connected by equals signs and 
ampersands), but the QUERY_STRING environment variable is not set. Instead, the post 
method sets the environment variable CONTENT_LENGTH , to indicate the number of char- 
acters of data that were sent (or posted). A benefit of the post method is that the number of 
characters of data can vary in size. 

Although methods get and post are similar, some important differences exist. A get 
request sends form content as part of the URL. A post request posts form content to the end 
of an HTTP request. Another difference is the manner in which browsers process 
responses. Browsers often cache (save on disk) Web pages, so that when the Web page is 
requested a second time, the browser need not download the page again, but can load the 
page from the cache. This process speeds up the user’s browsing experience by reducing 
the amount of data downloaded to view a Web page. Browsers do not cache the server 
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responses to post requests, however, because subsequent post requests might not contain 
the same information. 

This method of handling responses is different from that of handling get requests. 
When a Web-based search engine is used, a get request normally supplies the search engine 
with the information specified in the XHTML form. The search engine then performs the 
search and returns the results as a Web page. 



Most Web servers limit get request query strings to 1024 characters. Ifa query string exceeds 
this limit, use the post request. 



Forms that contain manyfields are submitted most often using a post request. Sensitive form 
fields. such as passwords, usually are sent using post request. 




6.6 Using egi . FieldStorage to Read Input 

Figure 6.10 reimplements the example from Fig. 6.9 to take advantage of a high-level data 
abstraction provided by module egi. Line 28 creates an object of class 
egi. FieldStorage. [Note: Classes are discussed in Chapter 7, Object-Based Pro- 
gramming.] In our example, the high-level data type (or class) is called 
egi . FieldStorage and resembles the dictionary returned by the parsing function. 


1 
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4 

5 
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7 

8 
9 

10 

11 

12 

13 

14 
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16 

17 

18 
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22 

23 

24 

25 

26 
27 


#!c: \Python\python .exe 

# Fig. 6.10: fig06_10.py 

# Demonstrates use of egi.FieldStorage an with XHTML form. 


import egi 


def printHeader( title ): 
print .'Content-type: 


% title 

printHeader( ) 

print 11 ""<p>Enter one of your favorite words here: 






Fig. 6.10 egi . FieldStorage used with an XHTML form. (Part 1 of 2.) 
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28 form = egi.FieldStorage() 

29 

30 if form.has_key( ): 

31 print "<p>Your word is; 

32 

33 % cgi.escape( form[ ].value ) 

34 

35 print "</bodyx/html>" 


\ 



1 3 Using egi.FieldStorage with forms - Micros 


File Edit View Favorites Tools Help 


nJ-j Back - ^ Q?] Qsearch 

» 

Address |||] http://localhost/cgi-bin/fig06 10.py 

73 

D 

Enter one of your favonte words here: 



Submit word 

J 


Your word is: CGI 


J 

Done ^ Local intranet 



Fig. 6.10 egi . FieldStorage used with an XHlNILform. (Part 2 of 2.) 


Line 30 calls dictionary method has_key and passes form, to determine whether the 
dictionary contains the key "word". If so, the user has entered a word, and the program 
prints the word to the browser (lines 31-33). Note that, to access the value of any key in a 
egi. FieldStorage object, we must access the value attribute of the key’s corre- 
sponding value. 


6.7 Other HTTP Headeis 

We mentioned at the close of Section 6.2.3 that there are alternatives to the Standard HTTP 
header 


Content-type: text/html 

For example, 

print "Content-type: text/plain" 

prints the Content-type header with the text/plain content type. If the con¬ 
tent- type of a page is specified as text/plain, the page is processed as plain text 
instead of as an HTML or XHTML document. 

In addition to HTTP header Content-type, a CGI script can supply other HTTP 
headers. In most cases, the server passes these extra headers to the client untouched. For 
example, the following Refresh header redirects the client to a new location after a spec¬ 
ified amount of time: 

Refresh: "5; URL = http://www.deitel.com/newpage.html" 





























































pythonhtpl_06.fm Page 215 Saturday, December 8, 2001 1:27 PM 


Chapter 6 Introduction to the Common Gateway Interface (CGI) 215 


Five seconds after the Web browser receives this header, the browser requests the resource 
at the specified URL. Alternatively, the Refresh header can omit the URL, in which case 
it refreshes the current page at the given time interval. 

The CGI protocol indicates that certain types of headers output by a CGI script are to 
be handled by the server, rather than be passed directly to the client. The first of these is the 
Location header. Like the Ref resh header, Location redirects the client to a new 
location: 

Location: http://www.deitel.com/newpage.html 

If used with a relative URL (e.g., Location: /newpage . html), the Location head¬ 
er indicates to the server that the redirection is to be performed on the server side, without 
sending the Location header back to the client. In this case, it appears to the user as if 
the browser originally requested that resource. When a Python script uses the Location 
header, the Content - type header is not necessary because the new resource has its own 
content type. 

The CGI specification also includes a Status header, which telis the server to output 
a status-header line (e.g., HTTP/1.1 200 OK). Normally, the server sends the appropriate 
status line to the client (adding, for example, the 2 0 0 OK status code in most cases). How- 
ever, CGI allows you to change the response status if you so desire. For example, sending a 

Status: 204 No Response 

header indicates that, although the request was successful, the browser should continue to 
display the same page. This header might be useful if you want to allow users to submit 
forms without moving to a new page. 

We now have covered the fundamentals of the CGI protocol. To review, the CGI pro¬ 
tocol allows Scripts to interact with servers in three basic ways: 

1. through the output of headers and content to the client via Standard output; 

2. by the server’s setting of environment variables (including the URL-encoded 
QUERY_STRING) whose values are available within the script (via os . envi- 
ron); and 

3. through posted, URL-encoded data that the server sends to the script’s Standard 
input. 

6.8 Example: Interactive PortaI 

Figure 6.11 and Fig. 6.12 show the implementation of a simple interactive portal (login 
page) for the fictional Bug2Bug Travel Web site. The example queries the client for a name 
and password, then displays information based on data entered. For simplicity, the example 
does not encrypt the data sent to the server. 

Figure 6.11 displays the opening page. It is a static XHTML document containing a 
form that posts data to the fig06 12 .py CGI script (line 14). The form contains one 
field to collect the client’s name (line 17) and one to collect the member password (line 20). 
To make this XHTML file available from an Apache server, place f ig06_ll .html in 
the root directory of the Apache server (e.g., Apache Group\Apache\htdocs). For 
more information on Apache servers, visit www. apache . org. 
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<?xml version = encoding = 

<!DOCTYPE html PUBLIC 


<!-- Fig. 6.11: fig06_ll.html --> 
<!-- Bug2Bug Travel log-in page. --> 


<html xmlns = "http: )/xhtml"> 

<headxtitle>Enter here</titlex/head> 


<body> 

<hl>Welcome to Bug2Bug Travel</hl> 

<form method = action = ^"> 


<p>Please enter your name xbr /> 

<input type = name = " /xbr /> 


Members, please enter the passwordxbr /> 

<input type = name = /xbr /> 

</p> 


<p style = 

Note that password is not encrypted.<br /xbr /> 
<input type = /> 

</p> 


> 



</form> 

</body> 

</html> 



Fig. 6.11 Interactive portalto create a password-protected Web page. 

Figure 6.12 is the CGI script that processes the data received from the client. Line 20 
retrieves the form data in a egi . FieldStorage instance and assigns the resuit to local 
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variable form. The i f structure that begins in line 22 tests whether form contains the key 
"name". If form does not contain that key, the user has not entered a name, and we 
print a Location HTTP header (line 23) to redirect the user to the XHTML file where 
the user can enter a name (f ig0 6_ll. html). The document fig06 11. html is con- 
tained in the Web server’ s main document root (as indicated by the / that precedes the page 
name). The effect of line 23 is that clients who try to access fig0 6_12 .py directly, 
without going through the login procedure, must enter through the portal. 




1 

#!c: \Python\python .exe 



2 

# Fig. 6.12: fig06 12.py 



3 

# Handles entry to Bug2Bug 

Travel. 


4 




5 

import egi 



6 




7 

def printHeader( title ): 



8 


:ext/html 


9 




10 


iing = 11 UTF-8" ?> 


11 




12 




13 




14 


.org/1999/xhtml"> 


15 




16 




17 

% title 



18 




19 

form = egi.FieldStorage() 



20 




21 

if not form.has key( 

) : 


22 

print 



23 

else : 



24 

printHeader( 

) 


25 

print 

% form[ 

].value 

26 

print 



27 




28 




29 

if not form.has key( 

) : 


30 

print 



31 



deals ! </p>." 

32 

elif form[ ]. 

.value == 

: 

33 

print 



34 



:<br /></p> 

35 




36 

else : 



37 

print 



38 




39 




40 




41 




42 

print 




Fig. 6.12 Interactive portal handler. (Part 1 of 2., 
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Fig. 6.12 Interactive portal handler. (Part 2 of 2.) 
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If a user has entered a name, we print a greeting that includes the user’s name and the 
weekly specials (lines 26-28). Line 30 tests whether the user entered a password. If the user 
has not entered a password, we invite the user to become a member (line 31). If the user has 
entered a password, line 32 determines whether the password is equal to the string 
"Coast2Coast", If true, we print the member specials to the browser. Note that the pass¬ 
word, weekly specials and member specials are hard-coded (i.e., their values are supplied 
in the code). If the user-entered password does not equal "Coast2Coast", the applica- 
tion requests the user to enter a valid password (lines 36-38). 

Performance Tip 6.1 

In response to eacli CGI request, a Web server executes a CGI program to create the re¬ 
sponse to the client. This process often takes more time than returning a static document. 
When implementing a Web site, define content that does not change frequently as static con- 
tent. This practice allows the Web server to respond to clients more quickly than ifonly CGI 
scripting were used. 

6.9 Internet and World Wide Web Resources 

www.w3.org/CGI 

The World Wide Web Consortium page on CGI is concemed with security issues involving the Com¬ 
mon Gateway Interface. This page provides links to CGI specifications, as indicated by the National 
Center for Supercomputing Applications (NCSA). 

www.nacs.uci.edu/indiv/ehood/MIME/MIME.html 

This document provides links to MIME RFCs (Request for Comments), MIME related RFCs and oth- 
er MIME-related information. 

www. speakeasy.org/-cgires 

This is a collection of tutorials and Scripts related to CGI. 

www.fastcgi,com 

This is the home page of fast CGI—an extension to CGI that for high performance Internet applications 

bel-epa.com/pyapache 

This site is the resource center for PyApache. PyApache is a module that embeds the Python in¬ 
terpreter into the Apache server. 

www.modpython.org 

This is the home page of mod python. Module modpython is another module that embeds the 
Python interpreter within the Apache server. This module lets Scripts run much faster than traditional 
CGI Scripts. 

SUMMARY 

• The Common Gateway Interface (CGI) describes a set of protocols through which applications 
(commonly called CGI programs or CGI Scripts) can interact with Web servers and (indirectly) 
with clients. 

• The content of dynamic Web pages does not require modification by programmers, however the 
content of static Web pages requires modification by programmers. 

• The Common Gateway Interface is “common” in the sense that it is not specific to any particular 
operating system (such as Linux or Windows) or to any one programming language. 

• HTTP describes a set of methods and headers that allow clients and servers to interact and ex- 
change information in a uniform and predictable way. 
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• A Web page in its simplest form is nothing more than an XHTML (Extensible Hypertext Markup 
Language) document. An XHTML document is just a plain-text file containing markings (markup, 
or tags) that describe to a Web browser how to display and format the information in the document. 

• Hypertext information creates links to different pages or to other portions of the same page. 

• Any XHTML file available for viewing over the Internet has a URL (Universal Resource Locator) 
associated with it. The URL contains information that directs a browser to the resource that the 
user wishes to access. 

• The hostname is the name of the computer where a resource (such as an XHTML document) re¬ 
sides. The hostname is translated into an IP address, which identifies the server on the Internet. 

• To request a resource, the browser first sends an HTTP request message to the server. The server 
responds with a line indicating the HTTP version, followed by a numeric code and a phrase de- 
scribing the status of the transaction. 

• The server normally sends one or more HTTP headers, which provide additional information 
about the data being sent. The header or set of headers is followed by a blank line, which indicates 
that the server has finished sending HTTP headers. 

• Once the server sends the contents of the requested resource, the connection is terminated. The cli- 
ent-side browser processes the XHTML it receives and displays the results. 

• get is an HTTP method that indicates that the client wishes to obtain a resource. 

• The function time. c time, when called with time, time (), retums a string value such as 

Wed Jul 18 10:54:57 2001. 

• Redirecting output means sending output to somewhere other than the Standard output, which is 
normally the screen. 

• Just as Standard input refers to the Standard method of input into a program (usually the keyboard), 
Standard output refers to the Standard method of output from a program (usually the screen). 

• If a server is not configured to handle CGI Scripts, the server may retum the Python program as 
text to display in a Web browser. 

• A properly configured Web server will recognize a CGI script and execute it. A resource is usually 
designated as a CGI script in one of two ways: Either it has a specific filename extension or it is 
located in a specific directory. The server administrator must explicitly give permission for remote 
clients to access and execute CGI Scripts. 

• When the server recognizes that the resource requested is a Python script, the server invokes Py¬ 
thon to execute the script. The Python program executes and the Web server sends the output to 
the client as the response to the request. 

• With a CGI script, we must explicitly include the Content-type header, whereas, with an 
XHTML document, the header would be added by the Web server. 

• The CGI protocol for output to be sent to a Web browser consists of printing to Standard output 
the Content - type header, a blank line and the data (XHTML, plain text, etc.) to be output. 

• Module egi provides functions that simplify the creation of CGI Scripts. Among other things, 
egi includes a set of functions to aid in dynamic XHTML generation. 

• The os . environ dictionary contains the names and values of ali the environment variables. 

• CGI-enabled Web servers set environment variables that provide information about both the serv- 
er’s and the client's script-execution environment. 

• The environment variable QUERY_STRING provides a mechanism that enables programmers to 
supply any type of data to CGI Scripts. The QUERY_STRING variable contains extra information 
that is appended to a URL, foliowing a question mark (?). The question mark is not part of the 
resource requested or of the query string. It simply serves as a delimiter. 
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• Data put into a query string can be structured in a variety of ways, provided that the CGI script that 
reads the string knows how to interpret the formatted data. 

• Forms provide another way for users to input information that is sent to a CGI script. 

• The <form> and </form> tags surround an XHTML form. 

• The < f orm> tag generally takes two attributes. The first attribute is action, which specifies the 
action to take when the user submits the form. The second attribute is method, which is either get 
or post. 

• Using get with an XHTML form causes data to be passed to the CGI script through environment 
variable QUERY_STRING, which is set by the server. 

• Web browsers URL-encode XHTML-form data that they send. This means that spaces are tumed 
into plus signs and that certain other symbols (such as the apostrophe) are translated into their 
ASCII value in hexadecimal and preceded with a percent sign. 

• A CGI script can supply HTTP headers in addition to Content - type. In most cases, the server 
passes these extra headers to the client untouched. 

• The Location header redirects the client to a new location. If used with a relative URL, the Lo - 
cation header indicates to the server that the redirection is to be performed without sending the 
Location header back to the client. 

• The CGI specification also includes a Status header, which informs the server to output a cor- 
responding status header line. Normally, the server adds the appropriate status line to the output 
sent to the client. However, CGI allows users to change the response status. 


TERMINOLOGY 

#! directive 
? in query string 
127.0.0.1 IP address 
action attribute 
button attribute 
protocol 

CSS (Cascading Style Sheet) 

CGI (Common Gateway Interface) 

CGI environment variable 

. egi file extension 

egi module 

CGI Script 

egi module 

egi. escape function 
egi. FieldStorage object 
egi .parse function 
egi .parse_qs function 
egi-b in directory 
checkbox attribute value (type) 
CONTENT LENGTH 
Content - type HTTP header 
domain name system (DNS) 
dynamic Web content 
environment variable 
file attribute value (type) 


HTTP header 

hidden attribute value (type) 

HTML (Hypertext Markup Language) 

HTTP (Hypertext Transfer Protocol) 

HTTP method 

HTTP transaction 

image attribute value (type) 

image/gi f MIME type 

input HTML element 

IP (Internet Protocol) address 

localhost 

Location HTTP header 

method of XHTML form 

MIME (Multipurpose Internet Mail Extensions) 

os. environ data member 

password attribute value (type) 

. py file extension 
post method 
portal 

pound-bang directive 
QUERYSTRING environment variable 
radio attribute value (type) 
redirect 

Ref resh HTTP header 


get method 


form XHTML element (<form>...</form>) relative URL 
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reset attribute value (type) 
select XHTML element (form) 
sh-bang directive (#!) 
static Web content 
Status HTTP header 
submit attribute value (type) 
text attribute value (type) 
text/html MIME type 
text/txt MIME type 
textarea XHTML element 
time module 
time. ctime function 


time. time function 
title XHTML element 
(<title>...</title>) 

URL (Universal Resource Locator) 
value attribute of 

egi. FieldStorage object 
Virtual URL 
document root 

XHTML (Extensible Hypertext 
Markup Language) 

XHTML form 
XHTML tag 


SELF-REVIEW EXERCISES 

6.1 Fili in the blanks in each of the following statements: 

a) CGI is an acronym for_. 

b) HTTP describes a set of_and_that allow clients and servers to in¬ 

ternet. 

c) The translation of a hostname into an IP address normally is performed by a_. 

d) The_, which is part of the HTTP header sent with every type of data, helps 

the browser determine how to process the data it receives. 

e) _are reserved memory locations that an operating systems maintains to keep 

track of system information. 

f) Function_takes a string and retums a properly formatted XHTML string. 

g) Variable_contains extra information that is appended to a URL in a get re- 

quest, following a question mark. 

h) The default target for print is_. 

i) The_data member contains all the environment variables. 

j) XHTML_allow users to input information to a CGI script. 

6.2 State whether each of the following is true or false. If false, explain why. 

a) The CGI protocol is not specific to any particular operating system or programming lan¬ 
guage. 

b) Function time . ctime retums a floating-point value that represents the number of sec- 
onds since the epoch. 

c) The first directive of a CGI script provides the location of the Python interpreter. 

d) The forward slash character acts as a delimiter between the resource and the query string 
in a URL. 

e) CGI Scripts are exeeuted on the client’s machine. 

f) The Status : 204 No Response header indicates that a request to the server failed. 

g) Redirection sends output to somewhere other than the screen. 

h) The action attribute of the form element specifies the action to take when the user 
submits the form. 

i) A post request posts form contents to the end of an HTTP request. 

j) Form data can be stored in an object of class egi . FormStorage. 


ANSWERS TO SELF REVIEW EXERCISES 

6.1 a) Common Gateway Interface. b) methods, headers. c) domain name server (DNS). d) MIME 
type, e) Environment variables. f) egi. escape. g) QUERY_STRING. h) Standard output. 
i) os . environ. j) forms. 
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6.2 a) True. b) False. Function ctime. time takes a floating-point value that represents the 
number of seconds since the epoch as an argument and retums a human-readable string representing 
the current time, c) True. d) False. A question mark acts as a delimiter between the resource and the 
query string in a URL. e) False. The server executes CGI Scripts, f) False. The Status : 2 04 No 
Response header indicates that, although the request was successful, the browser should continue 
to display the same page, g) True. h) True. i) True. j) False. Form data can be stored in an object of 
class egi. FieldStorage. 







EXERCISES 


6.3 Write a CGI script that prints the squares of the integers from 1 to 10 on separate lines. 

6.4 Modify your solution to Exercise 6.3 to display its output in an XHTML table. The left col- 
umn should be the number, and the right column should be the square of that number. 

6.5 Write a CGI script that receives as input three numbers from the client and retums a statement 
indicating whether the three numbers could represent an equilateral triangle (ali three sides are the 
same length), an isosceles triangle (two sides are the same length) or a right triangle (the square of 
one side is equal to the sum of the squares of the other two sides). 

6.6 Write a soothsayer CGI program that allows the user to submit a question. When the question 
is submitted, the server should display a random response from a list of vague answers. 


6.7 You are provided with a portal page (see the code and output below) where people can buy 
produets. Write the CGI script to enable this interactive portal. The user should specify how many of 
each item to buy. The total cost of the items purchased should be displayed to the user. 


1 

<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN"> 

2 

<! 

-- Exercise 6.7: ex06 07.html 

- - > 

3 

< ! 

-- Interactive portal that compiles shopping 

list based --> 

4 

5 

<! 

-- on user input. 

- - > 

6 

<html> 


7 


<head> 


8 


<title>Buy Something</title> 


9 


</head> 


10 




11 


<body> 


12 


<hl>Clearance! </hl> 


13 


<p>Please enter how many of each product 

you would like to 

14 


order into the box in the right-hand column. </p> 

15 




16 


<form method = pos action = 


17 



) 7.py" > 

18 




19 


ctable width = "100% border = ' s 3"> 


20 


<tr> 


21 


<th>Product Name:/th> 


22 


<th>Description</th> 


23 


<th>Price</th> 


24 


<th>Order</th> 


25 


</tr> 


26 
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27 

<tr> 





28 

<td>CD</td> 





29 

<td>Buy this really 

cool 

CD</ td> 



30 

<td>$12 . 00</td> 





31 

ctdxinput type = 


name = "CD ' 

/ 

></td> 

32 

</tr> 





33 






34 

<tr> 





35 

<td: Book</td> 





36 

<td>Buy this really 

cool 

book</td> 



37 

<td>$19 . 99</td> 





38 

<tdxinput type = 


name = ‘boc 


/x/td> 

39 

</tr> 





40 






41 

<tr> 





42 

<td>Airplane</td> 





43 

<td>Buy this really 

cool 

airplane</td> 


44 

<td>$l,000,000</td> 





45 

<tdxinput type = 


name = "ai 2 


/x/td> 

46 

</tr> 





47 

</table> 





48 






49 

<input type = "submit 11 value = 

1 submit" > 



50 

</form> 





51 

</body> 





52 < 

/html> 














6.8 Write a CGI script for a TV show survey. List five TV shows, let the survey participant rank 
the TV shows with numbers from 1 (least favorite) to 5 (most favorite). Display the participant's most 
favorite TV show. 
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Object-Based 

Programming 
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Objectives 

• To understand the software-engineering concepts of 
“encapsulation” and “data hiding.” 

• To understand the notions of data abstraction and 
abstract data types (ADTs). 

• To create Python ADTs, namely classes. 

• To understand how to create, use and destroy objects 
of a class. 

• To control access to object attributes and methods. 

• To begin to appreciate the value of object orientation. 
My object ali sublime 

I shall achieve in time. 

W. S. Gilbert 

Is it a world to hide virtues in? 

William Shakespeare, Twelfth Night 
Your public servants serve you right. 

Adlai Stevenson 

Classes struggle, some classes triumph, others are 
eliminated. 

Mao Zedong 

This above ali: to thine own selfbe true. 

William Shakespeare, Hamlet 





■m 
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O uti i ne 

7.1 Introduction 

7.2 Implementing a lime Absbact Data Type with a Class 

7.3 Spec ia I Attributes 

7.4 Controlling Access tD Attributes 

7.4.1 Getand SetMethods 

7.4.2 Ftivate Attributes 

7.5 Using Defautt Arguments Wrtb Constructore 

7.6 Destrue tors 

7.7 Class Attributes 

7.8 Composition: Object Fteferences as Membereof Classes 

7.9 Data Absbaction and Information hiding 

7.10 Software Reusability 

Summary • Terminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 







7.1 Introduction 


(tt) 


Now we begin our deeper study of object orientation. Through our discussion of Python 
programs in Chapters 2-6, we have already encountered many basic concepts (i.e., “object 
think’’) and terminology (i.e., “object speak’’). Let us briefly overview some key concepts 
and terminology of object orientation. Object-Oriented programming (OOP) encapsulates 
(i.e., wraps) data ( attributes ) and functions ( behaviors ) into components called classes. The 
data and functions of a class are intimately tied together. A class is like a blueprint. Using 
a blueprint, a builder can build a house. Using a class, a programmer can create an object 
(also called an instance). One blueprint can be reused many times to make many houses. 
One class can be reused many times to make many objects of the same class. Classes have 
a property called information hiding. This means that, although objects may know how to 
communicate with one another across well-defined interfaces, one object normally should 
not be allowed to know how another object is implemented—implementation details are 
hidden within the objects themselves. Surely it is possible to drive a car effectively without 
knowing the details of how engines, transmissions and exhaust systems work internally. 
We will see why information hiding is crucial to good Software engineering. 

In C and other procedural programming languages, programming tends to be action- 
oriented; in Python, programming can be object-oriented. In procedural programming, the 
unit of programming is th e junctiori. In object-oriented programming, the unit of program¬ 
ming is the class from which objects eventually are instantiated (i.e., created). 

Procedural programmers concentrate on writing functions. Groups of actions that per- 
form some task are formed into functions, and functions are grouped to form programs. 
Data certainly is important in procedural programming, but the view is that data exists pri- 
marily in support of the actions that functions perform. The verbs in a system specifica- 
tion—a document that describes the Services an application should provide—help the 
































pythonhtpl_07.fm Page 227 Saturday, December 8, 2001 2:29 PM 


Chapter 7 


Object-Based Programming 227 


procedural programmer determine the set of functions that will work together to implement 
the system. 

Object-Oriented programmers concentrate on creating their own user-defined types, 
called classes. Classes are also referred to as programmer-defined types. Each class con- 
tains data and the set of functions that manipulate the data. The data components of a class 
are called attributes (or data members). The functional components of a class are called 
methods (or member functions , in other object-oriented languages). The focus of attention 
in object-oriented programming is on classes rather than on functions. The nouns in a 
system specification help the object-oriented programmer determine the set of classes that 
will be used to create the objects that will work together to implement the system. 



A Central theme ofthis book is “reuse, reuse, reuse. ” We will carefully discuss a number of 
techniques for “polishing ” classes to encourage reuse. We focus on “crafting valuable class¬ 
es” and creating valuable “Software assets. ” 


7.2 Implementing a lime AbsbactData Type wrth a Class 

Classes enable programmers to model objects that have data (represented as attributes) and 
behaviors—or operations —(represented as methods). Methods are invoked in response to 
messages sent to objects. A message corresponds to a method call sent from one object to 
another. 

Classes simplify programming because the clients (or users of the class) need to be 
concerned only with the operations encapsulated or embedded in the object—the object 
interface. Such operations usually are designed to be client-oriented rather than implemen- 
tation-oriented. Clients do not need to be concerned with a class’s implementation 
(although clients, of course, want correct and efficient implementations). When an imple¬ 
mentation changes, implementation-dependent code must change accordingly. Hiding the 
implementation eliminates the possibility of other program parts becoming dependent on 
the details of the class implementation. 

Often, classes do not have to be created “from scratch.” Rather, they may be derived 
from other classes that provide attributes and behaviors the new classes can use—or classes 
can include objects of other classes as members. Such Software reuse can greatly enhance 
programmer productivity. Deriving new classes from existing classes is called inheritance 
and is discussed in detail in Chapter 9, Object-Oriented Programming: Inheritance. 

Figure 7.1 contains a simple definition for class Time. The class contains information 
that describes the time of day and contains methods for printing the time in two formats. 
The class maintains the time internally in a 24-hour format (i.e., military time), but allows 
the client to display the time in either 24-hour format or in “Standard” (AM, PM) format. 
Later in this section, we present a program (Fig. 7.2) that demonstrates how to create an 
object of class Time. 

Keyword class (line 4) begins a class definition. The keyword is followed by the 
name of the class (Time), which is followed by a colon (:). The line that contains keyword 
class and the class name is called the class’s header. The body of the class is an indented 
code block (lines 5-37) that contains methods and attributes that belong to the class. Class 
names usually follow the same naming conventions as variable names, except that the first 
word of the class name is capitalized. 
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1 

2 

3 

4 

5 

6 


# Fig. 7.1: Timel.py 

# Simple definition of class Time. 

class Time: 


7 

def init ( self 

) : 

8 



9 



10 

self.hour = 

# 0-23 

11 

self.minute = 

# 0-59 

12 

self.second = 

# 0-59 

13 



14 

def printMilitary( 

self ): 

15 



16 



17 

print '"% . 2d: % . 2c 

% \ 

18 

( self.hour. 

self.minute, self.second ), 

19 



20 

def printStandard( 

self ): 

21 



22 



23 

standardTime = 


24 



25 

if self.hour == 

or self.hour == : 

26 

standardTime 

+ = 

27 

else : 


28 

standardTime 

+= % ( self.hour % 

29 



30 

standardTime += 

% ( self.minute 

31 



32 

if self.hour < 

: 

33 

standardTime 

+ = 

34 

else : 


35 

standardTime 

+ = 

36 



37 

print standardTime, 


Fig. 7.1 Time class—containsattributesand methodsforstoring and displaying 
time of day. 



Common Programming Error 7.1 


Failure to include a colon at the end of a class definition header is a syntax error. 



Common Programming Error 7.2 


Failure to indent the body ofa class is a syntax error. 


Line 5 contains the class’s optional documentation string —a string that describes the 
class. If a class contains a documentation string, the string must appear in the line or lines 
following the class header. A user can view a class’s documentation string by executing the 
following statement 
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print ClassName. _doc_ 

Modules, methods and functions also may specify a documentation string. 

Good Programming Practice 7.1 

Include documentation strings, where appropriate, to enhance program clarity. 




Good Programming Practice 7.2 

By convention, docstrings are triple-quoted strings. This convention allows the class author 
to expand a program’s documentation (e.g., by adding several more lines) without having to 
change the quote style. 


Line 7 begins the definition for special method_ ini t _, the constructor method of 

the class. A constructor is a special method that executes each time an object of a class is 

created. The constructor (method_ init _) initializes the attributes of the object and 

returns None. Python classes may define several other special methods, identified by 

leading and trailing double-underscores (_) in the name. We discuss many of these special 

methods in Chapter 8, Customizing Classes. 



Common Programming Error 7.3 


Returning a value other than Nonefrom a constructor is afatal, runtime error. 



Ensure that objects are initialized before client code invokes those objects’ methods. Do not 
rely on client code to initialize objects properly. 



Good Programming Practice 7.3 

When appropriate (almost always), provide a constructor to ensure that every object is ini¬ 
tialized with meaningful values. 


All methods, including constructors, must specify at least one parameter. This param- 
eter represents the object of the class for which the method is called. This parameter often 
is referred to as the class instance object. This term can be confusing, so we refer to the first 
argument of any method as the object reference argument, or simply the object reference. 
Methods must use the object reference to access attributes and other methods that belong 
to the class. By convention, the object reference argument is called self. 


Common Programming Error 7.4 



Failure to specify an object reference (usually called self) as the first parameter in a meth¬ 
od definition causes fatal logic errors when the method is invoked at runtime. 



Good Programming Practice 7.4 

Name the first parameter of all methods self. This naming convention helps ensure confor- 
mity across Python programs written by different programmers. 


Each object has its own namespace that contains the object’s methods and attributes. The 
class’s constructor starts with an empty object (self) and adds attributes to the object’s 
namespace. For example, the constructor for class Time (lines 7-12) adds three attributes 
(hour, minute and second) to the new object’s namespace. Line 10 binds attribute hour 
to the object’s namespace and initializes the attribute’s value to 0. Once an attribute has been 
added to an object’s namespace, a client that uses the object may access the attribute’s value. 
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Class Time also defines methods printMilitary and printStandard. Notice 
that methods can specify a docstring, in the line or lines following the method header. In this 
example, each method specifies one parameter (sel f ) that refers to the object of the class for 
which the method is invoked. Each method accesses the object’s attributes through parameter 
self . Method printMilitary (lines 14—18)prints the time inmilitary (24-hour) format. 
Method printStandard (lines 20-37) prints the time in Standard (12-hour) format. 

Once a class has been defined, programs can create objects of that class. Many objects 
of a class can exist and programmers can create objects as necessary. This is one reason 
why Python is said to be an extensible language. The program in Fig. 7.2 creates an object 
of class Time, defined in Fig. 7.1. We first import the class definition from file 
Timel. py —the file that contains the class definition. Line 4 imports the definition in the 
same way a program would import any element from a module. 




1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 


# Fig. 7.2: fig07 02.py 

# Creating and manipulating objects of class Time. 

from Timel import Time # import class definition from file 
timel = TimeO # create object of class Time 


# access object's attributes 

print "The attributes of timel are: 

print , timel.hour 

print , timel.minute 

print , timel.second 


# access object's methods 
print " \nCalling method p 

timel.printMilitary() 


print 

timel.printStandard() 


# change value of objecfs attributes 

print " \n\nChanging timel's hour attr 

timel.hour = 

print "Calling method printMilitary a 

timel.printMilitary() 


The attributes of timel are: 
timel.hour: 0 
time1.minute: 0 
timel.second: 0 

Calling method printMilitary: 00:00:00 
Calling method printStandard: 12:00:00 AM 

Changing timel's hour attribute... 

Calling method printMilitary after alteration: 25:00:00 








Fig.7.2 Creating an object. 
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One of the fundamental principies of good Software engineering is that a client should 
not need to know how a class is implemented to use that class. Python’s use of modules 
facilitates this data abstraction—the program in Fig. 7.2 simply imports the Time defini- 
tion and uses class Time without knowing how the class is implemented. 



Clients of a class do nost need access to the class’s source code to use the class. 


To create an object of class Time, simply “call” the class name as if it were a function 
(line 6). This call invokes the constructor for class Time. Even though the class definition 

stipulates that the constructor (_ init _) takes one argument, line 6 does not pass any 

arguments to the constructor. Python inserts the first (object reference) argument into every 
method call, including a class’s constructor call. The constructor initializes the object’s 
attributes. Once the constructor exits, Python assigns the newly created object to timel. 

Client code must access an object’ s attributes through a reference to that object. Lines 
10-12 demonstrate how a program can access an object’s attributes through the dot (.) 
access operator. The name of the object appears to the left of the dot, and the attribute 
appears to the right of the dot. The output demonstrates the initial values that the con¬ 
structor assigned to attributes hour, minute and second. 

Client code can access an object’s methods in a similar manner. Line 16 calls timel’s 
printMilitary method. Notice again that the method call passes no arguments, even 
though the method definition specifies one parameter called self. Python passes a refer¬ 
ence to timel in the printMilitary call, so the method may access the object’s 
attributes. 

Line 23 modifies the value assigned to attribute timel. hour. The output from lines 
24-25 shows a problem that often arises when a client indiscriminately accesses an object’s 
data. The meaning of attribute hour is unclear, because that data member now has a value 
of 25. We say that the data member is in an inconsistent state (it contains an invalid value). 
Some other programming languages provide ways to prevent a client from accessing an 
object’s data. Python, on the other hand, does not provide such striet programming con- 
struets. Later in this chapter, we discuss the various ways Python programmers ensure that 
an object’s data remains in a consistent state. 


Common Programming Error 7.5 



Directly accessing an object’s attributes may cause the data to enter an inconsistent state. 


7.3 Spec ia I Attributes 

Classes and objects of classes both have special attributes that can be manipulated. These 
attributes, which Python creates when a class is defined or when an object of a class is cre¬ 
ated, provide information about the class or object of a class to which they belong. 
Figure 7.3 lists the special attributes that all classes contain. The interactive session in 
Fig. 7.4 prints the value of each of these attributes for class Time. 

Additionally, all objects of classes have attributes in common. Figure 7.5 lists these 
attributes, and the interactive session in Fig. 7.6 prints the attributes’ values for an object 

of class Time. Notice that objects can access the_ doc _and_ module _attributes 

that belong to the object’s class. 
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Attribute 

Desc ription 

bases 

A tuple that contains base classes from which the class directly inher- 
its. If the class does not inherit from other classes, the tuple is empty. 
[Note: We discuss base classes and inheritance in Chapter 9, Object- 
Oriented Programming: Inheritance.] 

dict 

A dictionary that corresponds to the class’s namespace. Each key- 
value pair represents an identifier and its value in the namespace. 

doc 

A class’s docstring. If the class does not specify a docstring, the value 


is None. 

module 

A string that contains the module (file) name in which the class is 
defined. 

name 

A string that contains the class’s name. 

Fig. 7.3 Special attributesof a class. 

Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 

win32 


Type "help", "Copyright", "credits" or "license" for more informa- 

tion. 


>>> 


>>> from Timel 
>>> print Time. 
() 

>>> print Time. 

import Time 
bases 

dict 

{ ' printMilitary 

' : <function printMilitary at 0x0079BF80>, 

1 module 1 : ' 

Timel 1 , ' doc ': 'Time abstract data type (ADT) 

definition 1 , 1 

init 1 : <function init at 0x0077AB00>, 

1 printStandard ' 

: <function printStandard at 0x00769990>} 

>>> 


>>> print Time. 

doc 

Time abstract data type (ADT) definition 

>>> print Time. 
Timel 

module 

>>> print Time. 
Time 

name 

Fig. 7.4 Special attributesof a class. 

Attribute 

Desc ription 

class 

A reference to the class from which the object was instantiated. 

dict 

A dictionary that corresponds to the object’s namespace. Each key- 
value pair represents an identifier and its value in the namespace. 


Fig. 7.5 Special attributesof an objectof a class. 
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Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 
win32 

Type "help", "Copyright", "credits" or "license" for more Informa¬ 
tion. 

>>> 

>>> from Timel import Time 
>>> timel = TimeO 

>>> print timel._class_ 

Timel.Time 

>>> print timel._dict_ 

{'second': 0, 'minute': 0, 'hour': 0} 

>>> print timel._doc_ 

Time abstract data type (ADT) definition 

>>> print timel._module_ 

Timel 


Fig. 7.6 Special attributesof an object. 

These attributes contribute to Python’s strong introspection capabilities (i.e., Python’s 
ability to provide information about itself). Many programmers use these capabilities to create 
advanced, dynamic and flexible applications. In this text, we use these capabilities mostly to 
explore how Python works and to further our understanding of programming concepts. 

7.4 Controlling Accessto Attributes 

In this chapter we already have discussed how clients can access an object’s attributes directly 
and how this practice can place an object’s data in an inconsistent state. Most object-oriented 
programming languages allow an object to prevent its clients from accessing the object’s data 
directly. However, in Python, the programmer uses attribute naming conventions to hide data 
from clients. In this section, we discuss the advantages and disadvantages of this practice. 

7.4.1 Getand SetMethods 

Although a client can access an object’s data directly (and perhaps cause the data to enter 
an inconsistent state), a programmer can design classes to encourage correct use. One tech- 
nique is for the class to provide access methods through which the data of the class can be 
read and written in a carefully controlled manner. 

Predicate methods are read-only access methods that test the validity of a condition. 
An example of a predicate method is an isEmpty method for a Container class—a class 
capable of holding many objects. A program calls isEmpty before reading another item 
from the Container object. An isFull predicate method tests a Container object to deter- 
mine whether it has additional space in which a program can place an item. Some appro- 
priate predicate methods for our Time class might be isAM and isPM. 

When a class defines access methods, a client should access an object’s attributes only 
through those access methods. A typical manipulation might be the adjustment of a cus- 
tomer’s bank-account balance (e.g., an attribute of an object of class BankAccount) by 
a method computelnterest. 

Classes often provide methods that allow clients to set (write) or get (read) the values of 
attributes. Although these methods need not be called set and get, they often are, by conven- 
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tion. More specifically, a method that sets data member interestRate typically would be 
named setlnterestRate, and a method that gets the interestRate typically would 
be named getlnterestRate. Get methods also are called “query” methods. 

It may seem that providing both set and get capabilities provides no benefit over 
accessing the attributes directly, but there is a subtle difference. A get method seems to allow 
clients to read the data at will, but the get method can control the formatting of the data. A set 
method can—and most likely should—scrutinize attempts to modify the value of the 
attribute. This ensures that the new value is appropriate for that data item. For example, a set 
method can reject the following values: the value 37 as the date, a negative value as a person’s 
body weight and the value 185 on an exam (when the grade range is 0-100). 



Controlling access, especially write access, to attributes through access methods helps en- 
sure data integrity. 



Testing and Debugging Tip 7.1 

Data integrity is not automatic, even if the programmer provides access methods—the pro- 
grammer must provide for validity checking. 


A class’s set methods sometimes return values that indicate attempts were made to 
assign invalid data to an object of the class. Clients of the class then test the return values 
of set methods to determine whether the object it is manipulating is a valid object and to 
take appropriate actions if the object is not valid. Alternatively, a set method may specify 
that an error message—called an exception —be sent (“raised”) to the client when the client 
attempts to assign an invalid value to an attribute. Raising exceptions is a topic we explore 
in detail in Chapter 12, Exception Handling. Exceptions are the preferred technique for 
handling invalid attribute values in Python. 



Good Programming Practice 7.5 

Methods that set the values of data should verify that the intended new values are proper. If 
they are not, the set methods should indicate that an error has occurred. 



Accessing data through set and get methods not only protects the datafrom assuming invalid 
values, but also insulates clients ofthe class from the representation ofthe data. Thus, ifthe 
representation ofthe data changes (typically to reduce the amount ofstorage required or to 
improve performance), only the method bodies need to change—the clients need not change 
as long as the interface provided by the methods remains the same. 


Figure 7.7— Time2 . py— defines a modified Time class that uses access methods to 
protect access to the data stored in the class. 


1 

2 

3 

4 

5 

6 


# Fig: 7.7: Time2.py 

# Class Time with accessor methods. 

class Time: 


Fig. 7.7 Access methods defined fore Ia ss Time. (Part 1 of 3.) 
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7 

def init ( self ): 


8 

"""Time constructor initializes each data 


9 



10 

self. hour = 


11 

self. minute = 


12 

self. second = 


13 



14 

def setTime( self, hour, minute, second ): 


15 



16 



17 

self.setHour( hour ) 


18 

self.setMinute( minute ) 


19 

self.setSecond( second ) 


20 



21 

def setHour( self, hour ) : 


22 



23 



24 

if <= hour < : 


25 

self. hour = hour 


26 

else : 


27 

raise ValueError, 

% hour 

28 



29 

def setMinute( self, minute ): 


30 



31 



32 

if <= minute < : 


33 

self. minute = minute 


34 

else : 


35 

raise ValueError, 

% minute 

36 



37 

def setSecond( self, second ): 


38 



39 



40 

if <= second < : 


41 

self. second = second 


42 

else : 


43 

raise ValueError, 

% second 

44 



45 

def getHour( self ): 


46 



47 



48 

return self. hour 


49 



50 

def getMinute( self ): 


51 



52 



53 

return self. minute 


54 



55 

def getSecond( self ): 


56 



57 



58 

return self. second 


59 




Fig. 7.7 Accessmethodsdefined fore Ia ss Time. (Part 2 of 3.) 
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60 

def printMilitary( self ) 

: 

61 



62 



63 

print '%. 2d:% . 2d:%.2d" 

% \ 

64 

( self. hour, self. 

minute, self. second ), 

65 



66 

def printStandard( self ) 

: 

67 



68 



69 

standardTime = 


70 



71 

if self. hour == or 

self. hour == : 

72 

standardTime += 


73 

else : 


74 

standardTime += 

% ( self. hour % ) 

75 



76 

standardTime += 

% ( self. minute, self 

77 



78 

if self. hour < : 


79 

standardTime += 


80 

else : 


81 

standardTime += 


82 



83 

print standardTime, 



Fig.7.7 Access methodsdefined fore Ia ss Time. (Part3of 3.] 


(«) 


Notice that the constructor creates attributes with single leading underscores (_) in 
lines 10-12. Attribute names that begin with a single underscore have no special meaning 
in the syntax of the Python language itself. However, the single leading underscore is a con- 
vention among Python programmers who use the class. When a class author creates an 
attribute with a single leading underscore, the author does not want users of the class to 
access the attribute directly. If a program requires access to the attributes, the class author 
provides some other means for doing so. In this case, we provide access methods through 
which clients should manipulate the data. 



Good Programming Practice 7.6 

An attribute with a single leading underscore conveys information about a class 's interface. 
Clients of a class that defmes such attributes should access and modify the attributes’ values 
only through the access methods that the class provides. Failing to do so often causes unex- 
pected errors to occur during program exeeution. 



Python’s classes and modularity encourage programs to be implementation independent. 
When the implementation ofa class used by implementation-independent code changes, that 
code need not be modified. 


Method setTime (lines 14-19) is the set method that clients should use to set all 
values in an object’s time. This method receives as arguments values for attributes _hour, 
_minute and _second. Methods setHour (lines 21-27), setMinute (lines 29-35) 
and setSecond (lines 37-43) are set methods for the individual attributes. These 
methods provide more flexibility to clients that modify the time. 
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Not ali methods need to serve as part of a class’s interface. Some methods serve as utility 
metliods to other methods ofthe class and are not intended to be used by clients ofthe class. 

Common Programming Error 7.6 

When inside a method, forgetting to use the object reference (often called self) to access 
another method defined by the object’s class is either afatal runtime error or a logic error. 
The logic error occurs when the global namespace contains afunction with the same nante 
as one ofthe class 's methods. In this case, forgetting to access the method nante through the 
object reference actually calls the global flmction. 

The comparison expressions in lines 24, 32 and 40 demonstrate Python’s comparison 
“chaining” syntax that enables programmers to write comparison expressions in familiar, 
arithmetic terms. Chained comparison expressions can be re-written with syntax familiar 
from other languages, using an appropriate and or or operation. For example, the state- 
ment in line 24 also could be written as 

hour >= and hour < 

Performance Tip 7.1 

Chained comparison expressions can be more efficient than their non-chained equivalents, 
because each terni in the chained comparison expressioit is evaluated only once. 

Method setHour (lines 21-27) changes an object’s _hour attribute. The method 
checks whether the value passed as a parameter is in the range 0-23, inclusive. If the hour 
is valid, the method updates attribute _hour with the new value. Otherwise, the method 
raises an exception , to indicate that the client has attempted to place the object’s data in an 
inconsistent state. An exception is a Python object that indicates a special event (most often 
an error) has occurred. For example, when a program attempts to access a nonexistent dic- 
tionary key, Python raises an exception. 

When an exception is raised a program either can catch the exception and handle it; or 
the exception can go uncaught, in which case the program prints an error message and ter- 
minates immediately. Catching and handling an exception enables a program to recognize 
and potentially fix errors that might otherwise cause a program to terminate. For example, 
a client that uses class Time can catch an exception and detect that the program has 
attempted to place data in an inconsistent state (i.e., set an invalid time). Catching and han¬ 
dling exceptions is a broad topic that we discuss in detail in Chapter 12, Exception Han¬ 
dling. For now, we discuss only how to raise an exception to indicate invalid data 
assignments and prevent data corruption. 

The statement in line 27 uses keyword raise to raise an exception. The keyword 
raise is followed by the name of the exception, a comma and a value that the exception 
object Stores as an attribute. When Python executes a raise statement, an exception is 
raised; if the exception is not caught, Python prints an emor message that contains the name 
of the exception and the exception’s attribute value, as shown in Fig. 7.8. 

The remaining methods— setMinute (lines 29-35) and setSecond (lines 37-43) 
change attributes _minute and _second, respectively. Each method ensures that the 
values remain in the range 0-59, inclusive. If the values are invalid, the methods raise 
exceptions and specify appropriate error-message arguments. 
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Python 2.2b2 (#26, Nov. 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 
win32 

Type "help", "Copyright", "credits" or "license" for more Informa¬ 
tion. 

>>> 

>>> raise ValueError, "This is an error message" 

Traceback (most recent call last): 

File "<stdin>", line 1, in ? 

ValueError: This is an error message 


Fig. 7.8 Raising an exception. 


Lines 45-58 contain the get methods for class Time. Clients use these methods 
(getHour, getMinute and getSecond) to retrieve the values of an attributes _hour, 
minute and _second, respectively. The remainder of the class definition does not 
differ from the previous definition we presented. 



Ifa class provides access methods for its data, clients should use only access methods to re- 
trieve/modify data. This “agreement” betw’een class and client helps maintain data in a con¬ 
sistent state. 



The class designer need not provide set or get methods for each data item; these capahilities 
should be provided only when appropriate. Ifthe ser\>ice is appropriate for clients, that Ser¬ 
vice should be provided in the class 's interface. 




Every method that modifies the data of an object should ensure that the data remains in a 
consistent state. 


Figure 7.9 contains a driver for modified class Time. A driver is a program that tests 
a class’s interface. Lines 4-6 import class Time from module Time2 and create an 
object of the class. Lines 9-12 call methods printMilitary and printStandard to 
display the initial time values of the object. 


1 # Fig. 7.9: fig07J)9.py 

2 # Driver to test class TimeControl. 

3 

4 from Time2 import Time 

5 

6 timel = TimeO 

7 

8 # print initial time 

9 print "The initial military time is 

10 timel.printMilitary() 

11 print "\nThe initial Standard time 

12 timel.printStandard() 








Fig. 7.9 Access methods called to change data. (Part 1 of 2.) 
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13 





14 

# change time 




15 

timel.setTime( , , 

) 



16 

print “ \n\nMilitary ti; 

1 



17 

timel.printMilitary() 




18 

print \nStandard time 

# 



19 

timel.printStandard() 




20 





21 

timel.setHour ( ) 




22 

timel.setMinute ( ) 




23 

timel.setSecond ( ) 




24 

print \n\nMi 1 itary ti: 



/ 

25 

timel.printMilitary () 




26 

print \nStandard time 



# 

27 

timel.printStandard () 




The 

initial military time 

is 00:00:00 



The 

initial Standard time 

is 12:00:00 AM 



Military time after setTime is 13:27:06 



Standard time after setTime is 1:27:06 PM 



Military time after setHour, setMinute, setSecond 

is 04:03:34 


Standard time after setHour, setMinute, setSecond 

is 4:03:34 AM 



Fig. 7.9 Accessmethodscalled to cha nge data. (Part 2 of 2.) 


Line 15 calls timel’s method setTime, passing values that correspond to 1:27:06 
PM, to change the object’s time values. Lines 16-19 call the appropriate methods to display 
the formatted times. The interactive session in Fig. 7.10 creates an object of class Time and 
calls method setTime to attempt to place the object’s data in an inconsistent state. Each call 
to method setTime contains an invalid value, and each call results in an emor message. 


Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 
win32 

Type "help", "Copyright", "credits" or "license" for more informa- 
tion. 

>>> 

>>> from Time2 import Time 

>>> timel = TimeO 

>>> 

>>> timel.setHour( 30 ) 

Traceback (most recent call last): 

File "<stdin>", line 1, in ? 

File "Time2.py", line 27, in setHour 

raise ValueError, "Invalid hour value: %d" % hour 
ValueError: Invalid hour value: 30 

(continued top ofnext page) 








Fig. 7.10 sefmethod called with invalid values. (Part 1 of 2.) 
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(continued from previous page) 

>» 

>>> timel.setMinute ( 99 ) 

Traceback (most recent call last): 

File "<stdin>", line 1, in ? 

File "Time2.py", line 35, in setMinute 

raise ValueError, "Invalid minute value: %d" % minute 
ValueError: Invalid minute value: 99 
>>> 

>>> timel.setSecond( -99 ) 

Traceback (most recent call last): 

File "<stdin>", line 1, in ? 

File "Time2.py", line 43, in setSecond 

raise ValueError, "Invalid second value: %d" % second 
ValueError: Invalid second value: -99 


Fig. 7.10 sefmethod called with invalid values. (Part2 of 2.) 







7.4.2 Private Attributes 


In programming languages such as C++ and Java, a class may state explicitly which at¬ 
tributes or methods may be accessed by clients of the class. These attributes or methods are 
said to be public. Attributes and methods that may not be accessed by clients of the class 
are said to be private. 

In Python, an object’s attributes may always be accessed—there is no way to prevent 
other code from accessing the data. However, Python does provide a way to prevent indis- 
criminate access to data. Suppose we want to create an object of class Time and to prevent 
the following assignment statement 


timel.hour = 


To prevent such access, we prefix the name of the attribute with two underscore char- 

acters (_). When Python encounters an attribute name that begins with two underscores, 

the interpreter performs name mangling on the attribute, to prevent indiscriminate access 
to the data. Name mangling changes the name of an attribute by including information 
about the class to which the attribute belongs. For example, if the Time constructor con- 
tained the line 


self._hour = 

Python creates an attribute called _Time_hour, instead of an attribute called_ hour. 

Figure 7.11 contains an example in which we define a class Priva teClass that contains 

one public attribute publicData (line 10) and one private attribute_ privateData 

(line 11). The interactive session that follows (Fig. 7.12) demonstrates how to access an ob¬ 
ject’s data. 

First, in Fig. 7.12, we import the class from module Private and create an object 
called private. The statement 

print private.publicData 
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1 

# Fig. 7.11: Private.py 



2 

# Class with private data members. 



3 




4 

class PrivateClass: 



5 




6 




7 

def init ( self ): 



8 




9 




10 

self.publicData = 

# 

public data member 

11 

self. privateData = 

■ # 

private data member 


Fig. 7.11 ClassPrivateClass with private data. 







Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 
win32 

Type "help", "Copyright", “credits" or "license" for more Informa¬ 
tion. 

>>> 

>>> from Private import PrivateClass 
>>> private = PrivateClass() 

>>> print private.publicData 
public 

>>> print private._privateData 

Traceback (most recent call last): 

File "<stdin>", line 1, in ? 

AttributeError: PrivateClass instance has no attribute 

1 _privateData 1 

>>> 

>>> print private._PrivateClass_privateData 

private 

>>> private._PrivateClass_privateData = "modified" 

>>> print private._PrivateClass_privateData 

modified 


Fig. 7.12 Private data accessed. 


behaves as expected—Python prints the value of the public attribute. When we write the 
statement 


print private._privateData 

Python prints an error message which explains that class PrivateClass does not con- 

tain an attribute called_ privateData. We prefixed our attribute name with double un- 

derscores, so Python changed the name of the attribute in the class definition. 

However, we can stili access the data, because we know that Python renames attribute 

_privateData to attribute _PrivateClass_privateData. Therefore, the line 

print private._PrivateClass_privateData 

successfully prints the value assigned to the private attribute. The final two statements in 
the session demonstrate that private data may be modified in the same way as public data. 
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However, accessing and modifying private attributes in this manner violates the data en- 
capsulation the class author intended. A client should never perform such a manipulation, 
but instead should use any access methods the class provides. 



Mcike private any data that the client should not access. 




Python programmers use private attributes for different reasons. Some programmers 
use private attributes to avoid common scoping problems that may arise in inheritance hier- 
archies. [Note: We discuss inheritance in Chapter 9, Object-Oriented Programming: Inher¬ 
itance.] Other programmers use private attributes for data or methods the client should 
never access. These attributes or methods are essential to the inner workings of the class, 
but are not part of the class’s interface. For example, a class author might designate a utility 
method by prepending the method name with two underscores. In this chapter, we use pri¬ 
vate attributes to demonstrate access methods and to introduce a basic data integrity tech- 
nique. In the next chapter, we discuss other ways to ensure data integrity. The techniques 
we discuss in the next chapter allow programmers to use public access syntax but also to 
take advantage of the data integrity provided by access methods. This practice enables pro¬ 
grammers to add data integrity to a project as the project grows and matures, without having 
to change the interface on which the project’ s clients have come to rely. 


7.5 Using Defauft Arguments \Mtih Construetors 


(«) 


Thus far, the client has supplied all the values that the constructor for class Time needed 
to initialize a new object. However, constructors can define default arguments that specify 
initial values for an object’s attributes, if the client does not specify an argument at con- 
struction time. Constructors also can define keyword arguments that enable the client to 
specify values for only certain, named arguments. Figure 7.13— Time3 .py —defines a 
modified version of class Time that redefines the Time constructor to include the default 
value 0 for each argument. Providing a default constructor guarantees that objects will be 
initialized to consistent States, even if no values are provided in constructor calls. Program- 
mer-supplied constructors that default all their arguments (or explicitly require no argu¬ 
ments) are also called default constructors (i.e., constructors that can be invoked with no 
arguments.) 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 


# Fig: 7.13: Time3.py 

# Class Time with default constructor. 

class Time: 


def init_( self, hour = , minute = 


self.setTime( hour, minute, second ) 


second = ): 








Fig. 7.13 Defaultconstmctordefined forelassTime. (Part 1 of 3.) 
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12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 
63 


def setTime( self, hour, minute, second ): 


self.setHour( hour ) 
self.setMinute( minute ) 
self.setSecond( second ) 

def setHour( self, hour ): 


if <= hour < : 

self._hour = hour 

else : 

raise ValueError, 
def setMinute( self, minute ): 

if <= minute < : 

self._minute = minute 

else : 

raise ValueError, 
def setSecond( self, second ): 

if <= second < : 

self._second = second 

else : 

raise ValueError, 
def getHour( self ): 

return self._hour 

def getMinute( self ): 

return self._minute 

def getSecond( self ): 

return self._second 

def printMilitary( self ): 

print % \ 

( self. hour, self. minute, self. 


% hour 


% minute 



% second 


second ), 






Fig. 7.13 Default constructordefined fore lassTime. (Part 2 of 3.) 
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64 

def printStandard( self ): 


65 



66 



67 

standardTime = 


68 



69 

if self. hour == or 

self. hour == : 

70 

standardTime += 


71 

else : 


72 

standardTime += 

% ( self. hour % ) 

73 



74 

standardTime += 

% ( self. minute, self. second ) 

75 



76 

if self. hour < : 


77 

standardTime += 


78 

else : 


79 

standardTime += 


80 



81 

print standardTime, 



Fig. 7.13 Default constructordefined fore lassTime. (Part 3 of 3.) 






In this example, the constructor invokes method setTime with the values passed to 
the constructor (or the default values). The class uses private attributes to store data. As 
with the previous definition of Time, setTime uses the class’s other methods, which 

ensure that the value supplied for_ hour is in the range 0-23 and that the values for 

_minute and_ second are each in the range 0-59. If a value is out of range, the 

appropriate method raises an exception (this is an example of ensuring that a data member 
remains in a consistent state). 

The Time constructor could have included the same statements as method setTime. 
This may be slightly more efficient because the extra call to setTime is eliminated. 
Coding the Time constructor and method setTime identically, however, makes main- 
taining this class more difficult. If the implementation of method setTime changes, the 
implementation of the Time constructor should change accordingly. Instead, any changes 
to the implementation of setTime need to be made only once, because the Time con¬ 
structor calls setTime directly. This reduces the likelihood of a programming error when 
altering the implementation. 



If a method ofa class already provides ali or part ofthefunctionality required by a construc¬ 
tor (or other method) ofthe class, call that method from the constructor (or other method). 
This simplifies the maintenance ofthe code and reduces the likelihood of an error ifthe im¬ 
plementation ofthe code is moclified. As a general rule: Avoid repeating code. 


Figure 7.14 initializes four objects of class Time (defined in Fig. 7.13)—one with all 
three arguments defaulted in the constructor call, one with one argument specified, one with 
two arguments specified and one with three arguments specified. The values of each object’s 
attributes after initialization are displayed by calling printTimeValues (lines 6-10). 

If no constructor is defined for a class, the interpreter creates a default constructor (i.e., 
one that can be called with no arguments). However, the constructor that Python provides 
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does not perform any initialization, so, when an object is created, the object is not guaran- 
teed to be in a consistent state. 







1 # Fig. 7.14: fig07 14.py 

2 # Demonstrating default constructor method for class Time. 

3 

4 from Time3 import Time 

5 

6 def printTimeValues( timeToPrint ): 

timeToPrint.printMilitary() 

8 print 

9 timeToPrint.printStandard () 


10 

print 



11 




12 

timel = TimeO 

# 

ali default 

13 

time2 = Time( ) 

# 

minute, second default 

14 

time3 = Time( , ) 

# 

second default 

15 

time4 = Time( , , 

) 

ali specified 

16 




17 

print "Constructed with:' 



18 




19 

print " \nall arguments d< 



20 

printTimeValues( timel ) 



21 




22 

print "\nhour specified; 



23 

printTimeValues( time2 ) 



24 




25 

print " \nhour and minute 



26 

printTimeValues( time3 ) 



27 




28 

print "\nhour, minute am 



29 

printTimeValues( time4 ) 
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7.6 Destructo is 

A constructor is a method that initializes a newly created object. Conversely, a destructor 
executes when an object is destroyed (e.g., after no more references to the object exist). A 

class can define a special method called_ dei _that executes when the last reference to 

an object is deleted or goes out of scope 1 . The method itself does not actually destroy the 
object—it performs termination housekeeping before the interpreter reclaims the object’s 
memory, so that memory may be reused. A destructor normally specifies no parameters 
other than self and returns None. 

We have not defined method_ dei _for the classes presented to this point. In pro¬ 

gramming languages such as C++, destructors often allocate and recycle memory. Python 

handles most of these issues for the programmer, so_ dei _normally is not included in 

the class definition. Occasionally, a class defines_ dei _to close a network or a data- 

base connection before destroying an object. We discuss these issues throughout the text, 

as appropriate. In the next section, we define method_ dei _for a class, to maintain a 

count of all objects of the class that have been created. 


7.7 Class Attribute s 




Each object of a class has copies of all the attributes created in the constructor. In certain 
cases, only one copy of an attribute should be shared by all objects of a class. A class at¬ 
tribute is used for this reason. A class attribute represents “class-wide” information (i.e., a 
property of the class, not of a specific object of the class). 

We now consider a video-game example to justify the need for class-wide data. Sup- 
pose that we have a video game with Martians and other space creatures. Each Martian 
tends to be brave and willing to attack other space creatures when the Martian is aware 
that there are at least four other Martians present. If there are fewer than five Martians 
present, each Martian becomes cowardly. For this reason, each Martian must know the 
martianCount. We could endow each object of class Martian withmartianCount 
as an attribute. However, if we do this, then every Martian would have a separate copy 
of the attribute, and, each time we create a Martian. we would have to update attribute 
martianCount in every Martian. The redundant copies waste space, and updating 
those copies is time-consuming. Instead, we create martianCount as a class attribute so 
that martianCount is class-wide data. Each Martian can see the martianCount as 
if it were an attribute of that Martian, but Python maintains only one copy of the mar¬ 
tianCount attribute to save space. This technique also saves time; because there is only 
one copy, we do not have to increment separate copies of martianCount for each object 
of class Martian. 

Performance Tip 7.2 


When a single copy ofthe data will suffice, use class attributes to save storage. 


1. Actually, there are some cases in which_ dei _does not execute immediately after the last ref¬ 

erence to an object is deleted. However, in most cases, it is safe to assume that the method executes 
whenexpected. See www.python.org/doc/current/ref /customization.html for 
more information. 
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Although class attributes may seem like global variables, each class attribute resides 
in the namespace of the class in which it is created. Class attributes should be initialized 
once (and only once) in the class definition. A class’s class attributes can be accessed 
through any object of that class. A class’s class attributes also exist even when no object of 
that class exists. To access a class attribute when no object of the class exists, prefix the 
class name, followed by a period, to the name of the attribute. 



A class's class attributes can be used even ifno objects ofthat class have been instantiated. 


Class Employee (Fig. 7.15) demonstrates how to define a class attribute that main- 
tains a count of the number of objects of the class that have been instantiated. The class 
attribute count is initialized to 0 in the class definition (line 7). Notice that the creation of 
class attribute count appears in the body of the class definition, not inside a method. The 
statement has the effect of defining a new variable named count, with value 0, and adding 
that variable to class Employee’s namespace. 






1 # Fig. 7.15: EmployeeWithClassAttribute,py 

2 # Class Employee with class attribute count. 

3 

4 class Employee: 

5 

6 

count = 

8 

9 def init ( self, first, last ): 

10 """Initializes firstName, lastName and increments 

11 

12 self.firstName = first 

13 self.lastName = last 

14 

15 Employee.count += 

16 

17 print \ 

18 % ( self.lastName, self.firstName ) 

19 

20 def dei ( self ) : 

21 .'Decrements count and prints message""» 

22 

23 Employee.count -= 

24 

25 print \ 

26 % ( self.lastName, self.firstName ) 


Fig. 7.15 Class attributes—class Employee. 


1 # Fig. 7.16: fig07_16.py 

2 # Demonstrating class attribute access. 

3 


Fig. 7.16 Class attributes— f ig07_16 .py. (Parti of 2.) 
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4 from EmployeeWithClassAttribute import Employee 

5 


6 

7 

8 

9 

print "Number of employees before ins 

Employee.count 

# create two Employee objects 


, \ 

10 

employeel = Employee( , 

) 


11 

12 

13 

employee2 = Employee ( , 

employee3 = employeel 

) 


14 

15 

16 

print "Number of employees after inst 

employeel.count 


, \ 

17 

18 

19 

20 
21 

# explicitly delete employee objects 

dei employeel 
dei employee2 
dei employee3 

by removing 

references 

22 

23 

print "Number of employees after del( 

Employee.count 

, \ 



Number of employees before instantiation is 0 
Employee constructor for Baker, Susan 
Employee constructor for Jones, Robert 
Number of employees after instantiation is 2 
Employee destructor for Jones, Robert 
Employee destructor for Baker, Susan 
Number of employees after deletion is 0 


Fig. 7.16 Classattributes— f ig07_16 .py. (Part2of 2.) 

Figure7.16 access Employee’s class attribute. Class attribute count maintains a 
count of the number of existing objects of class Employee and can be accessed whether 
or not objects of class Employee exist. If no objects of the class exist, a program can ref- 
erence count through the class name (line 7). Lines 10-11 create two Employee objects. 
When each Employee object is created, its constructor is called. In the output, notice that 
creating identifier employee3 (line 12) does not create a new object of class Employee 
and therefore does not call Employee’s constructor. The statement simply binds a new 
name to the object created in line 18, so that employee3 and employeel refer to the 
same object. Lines 18-20 use keyword dei to delete all references to the two Employee 

objects. Method_ dei _for the object created in line 10 does not execute until the last 

reference to that object is deleted in line 20. 

7.8 Compositiori: Object References as Membersof Classes 

Until now, we have defined classes whose objects have attributes of basic types. Some- 
times, a programmer needs objects whose attributes are themselves references to objects of 
other classes. For example, an object of class AlarmClock needs to know when it is sup- 
posed to sound its alarm, so why not include an object of class Time as a member of the 
object of class AlarmClock? Such a capability is called compositiori. 
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Oneform of Software reusability is compositiori, in which a class has references to objects of 
other classes as members. 



If a class has as a member a reference to an object of another class, making that member 
object publicly accessible does not violate the encapsulation and hiding ofthat member ob¬ 
jecti private members. 


Figure 7.17 uses a class Date (Fig. 7.17) a modified class Employee (Fig. 7.18) and 
to demonstrate references to objects as members of other objects. Class Employee con- 
tains attributes firstName, lastName, birthDate and hireDate. Attributes 
birthDate and hireDate are objects of class Date, which contains attributes month, 
day and year. The program (Fig. 7.19) instantiates an object of class Employee and ini- 
tializes and displays its attributes. 




1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 


# Fig. 7.17: Date.py 

# Definition of class Date. 


class Date: 


# class attribute lists number of days in each month 

daysPerMonth = [ 


1 



def _ init_( self, month, day, year ): 


if < month <= : 

self.month = month 

else : 

raise ValueError, % month 

if year >= : 

self.year = year 

else : 

raise ValueError, % year 

self.day = self.checkDay( day ) 

print , 

self.display() 

def dei ( self ) : 


print " 

self.display() 








Fig. 7.17 Memberobjects— Date .py. (Part 1 of 2.) 
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35 

def display( self ): 



36 




37 




38 

print % ( 

self.month, self.day. 

self.year ) 

39 




40 

def checkDay( self, testDay ): 


41 




42 




43 

# validate day, test 

for leap year 


44 

if < testDay <= Date.daysPerMonth[ self.month ] : 

45 

return testDay 



46 

elif self.month == 

and testDay == and 

\ 

47 

( self.year % 

= = or 


48 

self.year % 

!= and self.year % 

= = ) : 

49 

return testDay 



50 

else : 



51 

raise ValueError, 


% \ 

52 

( testDay, self 

:.month ) 



Fig. 7.17 Memberobjects— Date.py. (Part2of 2.) 


In Fig. 7.18, the Employee constructor (lines 9-20) takes nine arguments— self, 
firstName, lastName, birthMonth, birthDay, birthYear, hireMonth, 
hireDay and hireYear —and creates objects of class Date from the last six argu¬ 
ments. Arguments birthMonth, birthDay and birthYear are passed to object 
birthDate’s constructor, and arguments hireMonth, hireDay and hireYear are 
passed to object hireDate’s constructor. Class Date and class Employee each define 

method_ dei _to print a message when an object of class Date or an object of class 

Employee is destroyed, respectively. 


1 # Fig. 7.18: EmployeeComposition.py 

2 # Definition of Employee class with composite members. 

3 

4 from Date import Date 

5 

6 class Employee: 

7 """Employee class with Date attributes""" 

8 

def _ init_( self, firstName, lastName, birthMonth, 

10 birthDay, birthYear, hireMonth, hireDay, hireYear ): 

11 .Constructor for class Employee""" 

12 

13 self.birthDate = Date( birthMonth, birthDay, birthYear ) 

14 self.hireDate = Date( hireMonth, hireDay, hireYear ) 

15 

16 self.lastName = lastName 

17 self.firstName = firstName 

18 

19 print \ 

20 % ( self.lastName, self.firstName ) 






Fig. 7.18 Memberobjects— EmployeeComposition.py. (Part 1 of 2.) 
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21 



22 

def dei ( self ): 


23 



24 



25 

print "Employee object about to be destroyed: %s, %s 

\ 

26 

% ( self.lastName, self.firstName ) 


27 



28 

def display( self ): 


29 



30 



31 

print % ( self.lastName, self.firstName ) 


32 

print , 


33 

self.hireDate.display() 


34 

print , 


35 

self.birthDate.display() 


Fig. 7.18 

Memberobjects— EmployeeComposition. py. (Part 2 of 2.) 



1 # Fig. 7.19: fig07 19,py 

2 # Demonstrating compositioni an 

3 

object with member 

obj ects . 


4 from Date import Date 

5 from EmployeeComposition import 

6 

Employee 



7 employee = Employee ( , 

8 print 

9 

III ! 

/ ! 

) 

10 employee . display () 

11 print 




Date constructor: 7/24/1949 

Date constructor: 3/12/1988 

Employee constructor: Jones, Bob 




Jones, Bob 

Hired: 3/12/1988 

Birth date: 7/24/1949 




Employee object about to be destroyed: Jones, Bob 



Date object about to be destroyed: 

3/12/1988 



Date object about to be destroyed: 

7/24/1949 




Fig. 7.19 Memberobjects—fig07_19 .py. 



7.9 Data Absbaction and Infbmiation Hiding 

As we pointed out at the beginning of this chapter, classes normally hide the details of their 
implementation from their clients. This is called information hiding. As an example of in- 
formation hiding, let us consider a data structure called a stack. 

Students can think of a stack as analogous to a pile of dishes. When a dish is placed on 
the pile, it is always placed at the top (referred to as pushing the dish onto the stack). Similarly, 
when a dish is removed from the pile, it is always removed from the top (referred to as pop- 
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ping the dish off the stack). Stacks are known as last-in, first-out (LIFO) data structures —the 
last item pushed (inserted) on the stack is the first item popped (removed) from the stack. 

Stacks can easily be implemented with lists, and in fact, Python lists contain methods 
that programers can use to make lists “act” like stacks. (We also implement our own class 
Stack in Chapter 22, Data Structures.) A client of a stack class need not be concerned with 
the stack’ s implementation. The client knows only that when data items are placed in the 
stack, these items will be recalled in last-in, first-out order. The client cares about what 
functionality a stack offers, but not about liow that functionality is implemented. This con- 
cept is referred to as data abstraction. Although programmers might know the details of a 
class’s implementation, they should not write code that depends on these details. This 
enables a particular class (such as one that implements a stack and its operations, push and 
pop ) to be replaced with another version without affecting the rest of the system. As long 
as the Services of the class do not change (i.e., every method stili has the same name, returns 
the same type of value and defines the same parameter list in the new class definition), the 
rest of the system is not affected. 

The job of a high-level language is to create a view convenient for programmers to use. 
There is no single accepted Standard view—that is one reason why there are so many pro¬ 
gramming languages. Object-Oriented programming in Python presents yet another view. 

Most programming languages emphasize actions. In these languages, data exists to 
support the actions that programs must take. Data is “less interesting” than actions. Data is 
“crude.” Only a few built-in data types exist, and it is difficult for programmers to create 
their own data types. The object-oriented style of programming in Python elevates the 
importance of data. The primary activities of object-oriented programming in Python is the 
creation of data types (i.e., classes) and the expression of the interactions among objects of 
those data types. To create languages that emphasize data, the programming-languages 
community needed to formalize some notions about data. The formalization we consider 
here is the notion of abstract data types (ADTs). ADTs receive as much attention today as 
structured programming did decades earlier. ADTs, however, do not replace structured pro¬ 
gramming. Rather, they provide an additional formalization to improve the program-devel- 
opment process. 

Consider the built-in integer type, which most people would associate with an integer in 
mathematics. Rather, the integer type is an abstract representation of an integer. Unlike math- 
ematical integers, computer integers are fixed in size. For example, the integer type on some 
computers is limited approximately to the range -2 billion to +2 billion. If the resuit of a cal- 
culation falis outside this range, an error occurs, and the computer responds in some machine- 
dependent manner. It might, for example, “quietly” produce an incorrect resuit. Mathematical 
integers do not have this problem. Therefore, the notion of a computer integer is only an 
approximation of the notion of a real-world integer. The same is true of the floating-point type 
and other built-in types. 

We have taken the notion of the integer type for granted until this point, but we now 
consider it from a new perspective. Types like integer, floating-points, strings and others 
are all examples of abstract data types. These types are representations of real-world 
notions to some satisfactory level of precision within a computer system. 

An ADT actually captures two notions: A data representation and the operations that 
can be performed on that data. For example, in Python, an integer contains an integer value 
(data) and provides addition, subtraction, multiplication, division and modulus operations; 
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however, division by zero is undefined. Python programmers use classes to implement 
abstract data types. 



Programmers can create types through the use ofthe class mechanism. These new types can 
be designed so that they are as convenient to use as the built-in types. This marks Python as 
an extensible language. Although the language is easy to extend via new types, the program- 
mer cannot alter the base language itself 


Another abstract data type we discuss is a queue , which is similar to a “waiting line.” 
Computer systems use many queues internally. A queue offers well-understood behavior 
to its clients: Clients place items in a queue one at a time via an enqueue operation, then get 
those items back one at a time via a dequeue operation. A queue returns items in first-in, 
first-out (FIFO) order, which means that the first item inserted in a queue is the first item 
removed. Conceptually, a queue can become infinitely long, but real queues are finite. 

The queue hides an internal data representation that keeps track of the items currently 
waiting in line, and it offers a set of operations to its clients (enqueue and dequeue). The cli¬ 
ents are not concerned about the implementation of the queue—clients simply depend upon 
the queue to operate “as advertised.” When a client enqueues an item, the queue should accept 
that item and place it in some kind of internal FIFO data structure. Similarly, when the client 
wants the next item from the front of the queue, the queue should remove the item from its 
internal representation and deliver the item in FIFO order (i.e., the item that has been in the 
queue the longest should be the next one returned by the next dequeue operation). 

The queue ADT guarantees the integrity of its internal data structure. Clients cannot 
manipulate this data structure directly—only the queue ADT has access to its internal data. 
Clients are able to perform only allowable operations on the data representation; the ADT 
rejects operations that its interface does not provide. This could mean issuing an error mes- 
sage, terminating execution, raising an exception (as discussed in Chapter 12, Exception 
Handling) or simply ignoring the operation request. 


7.10 Software Reusability 

Python programmers concentrate both on crafting new classes and on reusing classes from 
the Standard library, which contains hundreds of predefined classes. Developers construet 
Software by combining programmer-defined classes with well-defined, carefully tested, 
well-documented, portable and widely available Standard library classes. This kind of Soft¬ 
ware reusability speeds the development of powerful, high-quality Software. Rapid appli- 
cations development (RAD) is of great interest today. 

The Standard library enables Python developers to build applications faster by reusing 
preexisting, extensively tested classes. In addition to reducing development time, Standard 
library classes also improve programmers’ abilities to debug and maintain applications, 
because proven Software components are being used. For programmers to take advantage 
of the Standard library’s classes, they must familiarize themselves with the Standard 
library’s rich set of capabilities. 

In this chapter, we discussed how to define a class and to create objects of the class. 
When a new object is created, the class constructor initializes the new object’s attributes. 
We discussed several ways to initialize and modify attributes—default constructors, set 
methods and raising exceptions for invalid attribute values. We also discussed data integ- 
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rity, how all object attributes may be accessed directly by the client, how the single leading 
underscore (_) indicates that clients should not access attributes and how the double 

leading underscore (_) mangles an attribute’s name to prevent casual attribute access. 

Python’s direct attribute access encourages rapid application development and facilitates 
dynamic introspection; however, direct access is often insufficient for large-scale Software 
projects. In the next chapter, we discuss how class authors can ensure data integrity, while 
stili taking advantage of direct access syntax. This data integrity functionality can be added 
to the class without changing the interface the client uses to access an object’s data. This 
promotes both the safe, modular programming techniques and rapid development practices 
that Python programmers desire. 

SUMMARY 

• Object-Oriented programming (OOP) encapsulates (i.e., wraps) data (attributes) and functions (be- 
haviors) into components called classes. The data and functions of a class are intimately tied together. 

• A class is like a blueprint. Using a blueprint, a builder can build a house. Using a class, a program- 
mer can create an object (also called an instance). 

• Classes have a property called information hiding. Although objects may know how to communi¬ 
cate with one another across well-defined interfaces, one object normally should not be allowed 
to know how another object is implemented—implementation details are hidden within the objects 
themselves. 

• In procedural programming, the unit of programming is the function. In object-oriented program¬ 
ming, the unit of programming is the class from which objects eventually are instantiated. 

• Procedural programmers concentrate on writing functions. The verbs in a system specification 
help the procedural programmer determine the set of functions that will work together to imple- 
ment the system. 

• Object-Oriented programmers concentrate on creating their own user-defined types, called classes. 
The nouns in a system specification help the object-oriented programmer determine the set of 
classes that will be used to create the objects that will work together to implement the system. 

• Classes simplify programming because the clients need to be concerned only with the operations 
encapsulated or embedded in the object—the object interface. 

• Keyword class begins a class definition. The keyword is followed by the name of the class, 
which is followed by a colon (:). The line that contains keyword class and the class name is 
called the class’s header. 

• The body of the class is an indented code block that contains methods and attributes that belong 
to the class. 

• A class’s optional documentation string describes the class. If a class contains a documentation 
string, the string must appear in the line or lines following the class header. 

• Method_ init _is the constructor method of a class. A constructor is a special method that 

executes each time an object of a class is created. The constructor initializes the attributes of the 
object and retums None. 

• All methods, including constructors, must specify at least one parameter—the object reference. 
This parameter represents the object of the class for which the method is called. Methods must use 
the object reference to access attributes and other methods that belong to the class. 

• By convention, the object reference argument is called self. 

• Each object has its own namespace that contains the object’s methods and attributes. The class’s 
constructor starts with an empty object (self) and adds attributes to the object’s namespace. 
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• Once a class has been defined, programs can create objects of that class. Programmers can create 
objects as necessary. This is one reason why Python is said to be an extensible language. 

• One of the fundamental principies of good Software engineering is that a client should not need to 
know how a class is implemented to use that class. Python’s use of modules facilitates this data 
abstraction—a program can import a class definition and use the class without knowing how the 
class is implemented. 

• To create an object of a class, simply “call” the class name as if it were a function. This call invokes 
the constructor for the class. 

• Classes and objects of classes both have special attributes that can be manipulated. These at- 
tributes, which Python creates when a class is defined or when an object of a class is created, pro¬ 
vide information about the class or object of a class to which they belong. 

• Directly accessing an object’s data can leave the data in an inconsistent state. 

• Most object-oriented programming languages allow an object to prevent its clients from accessing 
the object’s data directly. However, in Python, the programmer uses attribute naming conventions 
to hide data from clients. 

• Although a client can access an object’s data directly (and perhaps cause the data to enter an in¬ 
consistent state), a programmer can design classes to encourage correct use. One technique is for 
the class to provide access methods through which the data of the class can be read and written in 
a carefully controlled manner. 

• Predicate methods are read-only access methods that test the validity of a condition. 

• When a class defines access methods, a client should access an object’s attributes only through 
those access methods. 

• Classes often provide methods that allow clients to set or get the values of attributes. Although 
these methods need not be called set and get , they often are. Get methods also are called “query” 
methods. 

• A get method can control the formatting of the data. A set method can—and most likely should— 
scrutinize attempts to modify the value of the attribute. This ensures that the new value is appro- 
priate for that data item. 

• A set method may specify that an error message—called an exception—be raised to the client 
when the client attempts to assign an invalid value to an attribute. 

• When a class author creates an attribute with a single leading underscore, the author does not want 
users of the class to access the attribute directly. If a program requires access to the attributes, the 
class author provides some other means for doing so. 

• Python comparisons may be chained. The chaining syntax that enables programmers to write com- 
parison expressions in familiar, arithmetic terms. 

• When an exception is raised a program either can catch the exception and handle it; or the exception 
can go uncaught, in which case the program prints an error message and terminates immediately. 

• The keyword raise is followed by the name of the exception, a comma and a value that the ex¬ 
ception object Stores as an attribute. When Python executes a raise statement, an exception is 
raised. If the exception is not caught, Python prints an error message that contains the name of the 
exception and the exception’s attribute value. 

• In programming languages such as C++ and Java, a class may state explicitly which attributes or 
methods may be accessed by clients of the class. These attributes or methods are said to be public. 
Attributes and methods that may not be accessed by clients of the class are said to be private. 

• To prevent indiscriminate attribute access, prefix the name of the attribute with two underscore 

characters (_). 
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• When Python encounters an attribute nante that begins with two underscores, the interpreter per- 
forms name mangling on the attribute, to prevent indiscriminate access to the data. Name man- 
gling changes the name of an attribute by including information about the class to which the 
attribute belongs. 

• Constructors can define default arguments that specify initial values for an object’s attributes, if 
the client does not specify an argument at construction time. 

• Constructors can define keyword arguments that enable the client to specify values for only cer- 
tain, named arguments. 

• Programmer-supplied constructors that default all their arguments (or explicitly require no argu¬ 
ments) are also called default constructors 

• If no constructor is defined for a class, the interpreter creates a default constructor. However, the 
constructor that Python provides does not perform any initialization, so, when an object is created, 
the object is not guaranteed to be in a consistent state. 

• A destructor executes when an object is destroyed (e.g., after no more references to the object 
exist). 

• A class can define a special method called_ dei _that executes when the last reference to an 

object is deleted or goes out of scope. A destructor normally specifies no parameters other than 
self and retums None. 

• A class attribute represents “class-wide” information (i.e., a property of the class, not of a specific 
object of the class). 

• Although class attributes may seem like global variables, each class attribute resides in the 
namespace of the class in which it is created. Class attributes should be initialized once (and only 
once) in the class definition. 

• A class’ s class attributes can be accessed through any object of that class. A class’ s class attributes 
also exist even when no object of that class exists. To access a class attribute when no object of 
the class exists, prefix the class name, followed by a period, to the name of the attribute. 

• Sometimes, a programmer needs objects whose attributes are themselves references to objects of 
other classes. Such a capability is called composition. 

• Stacks are known as last-in, first-out (LIFO) data structures—the last item pushed (inserted) on 
the stack is the first item popped (removed) from the stack. 

• Types like integer, floating-points, strings and others are all examples of abstract data types. These 
types are representations of real-world notions to some satisfactory level of precision within a 
computer system. 

• An ADT actually captures two notions: A data representation and the operations that can be per- 
formed on that data. Python programmers use classes to implement abstract data types. 

• A queue, is a “waiting line.” A queue offers well-understood behavior to its clients: Clients place 
iterns in a queue one at a time via an enqueue operation, then get those items back one at a time 
via a dequeue operation. 

• A queue returns items in first-in, first-out (FIFO) order, which means that the first item inserted in 
a queue is the first item removed. 

• Python programmers concentrate both on crafting new classes and on reusing classes from the 
Standard library. This kind of Software reusability speeds the development of powerful, high-qual- 
ity Software. 

• The Standard library enables Python developers to build applications faster by reusing preexisting, 
extensively tested classes. In addition to reducing development time, Standard library classes also 
improve programmers’ abilities to deb 
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TERMINOLOGY 

abstract data type (ADT) 
access method 
attribute 

_bases _attribute of a class 

behavior 
built-in data type 
class keyword 

_class _attribute of an object 

class body 
class instance object 
class library 
class scope 
composition 
consistent state 
constructor 
Container class 
data abstraction 
data member 
data type 
data validation 

_dei _method 

dei keyword 

dequeue 

destructor 

_dict _attribute of a class 

_dict _attribute of an object 

_doc _attribute of a class 

double underscore (_) 

encapsulation 

enqueue 

extensible language 
first in, first out (FIFO) 


gei access method 
inconsistent state 
information hiding 

_ini t _method 

instantiate 

interface 

last in, first out (LIFO) 
member function 
method 
module 

_module _attribute of a class 

_name _attribute of a class 

name mangling 
object 

object-oriented programming (OOP) 

popping off a stack 

predicate method 

private 

public 

pushing onto a stack 
queue 

rapid application development (RAD) 
reference 

self 

set access method 
single underscore (_) 

Software reuse 
stack 

structured programming 
termination housekeeping 
user-defined type 
utility method 


SELF-REVIEW EXERCISES 

7.1 Fili in the blanks in each of the following statements: 

a) Object-Oriented programming_data and functions into_. 

b) Method_is called the constructor. 

c) Classes enable programmers to model objects that have_(represented as data 

members) and behaviors (represented as_). 

d) A class’s methods are often referred to as_in other object-oriented program¬ 

ming languages. 

e) A_method tests the truth or falsity of a condition. 

f) A_is a variable shared by ali objects of a class. 

g) _are known as last-in, first-out data structures. 

h) A user of an object is referred to as a_. 

i) Python performs name mangling on attributes that begin with_underscore(s). 

j) Describing the functionality of a class independent of its implementation is called 
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State whether each of the following is true or false. If false, explain why. 

a) Object-Oriented programming languages do not use functions to perform actions. 

b) The parameter self must be the first item in a method's argument list. 

c) The class constructor retums an object of the class. 

d) Programmer-defined and built-in modules are imported in the same way. 

e) Constructors may specify keyword arguments and default arguments. 

f) An attribute that begins with a single underscore is a private attribute. 

g) The destructor is called when the keyword dei is used on an object. 

h) A shared class attribute should be initialized in the constructor. 

i) When invoking an object’s method, a program does not need to pass a value that corre- 
sponds to the object reference parameter. 

j) Every class should have a_ dei _method to reclaim an object’s memory. 

ANSWERS TO SELF-REVIEW EXERCISES 

7.1 a) encapsulates, classes, b)_ init_ . c) attributes, methods. d) member functions. 

e) predicate. f) class attribute, g) Stacks. h) client. i) two. j) data abstraction. 

7.2 a) False. Object-Oriented programmers use methods, or functions, as components of classes, 

b) False. The first parameter in a method’s argument must be an object of the class, which is called 
self by convention. c) False. The class constructor initializes an object of the class and implicitly 
retums None, d) True. e) Tme. f) False. An attribute that begins with a single underscore conveys the 
convention that a client of a class should not access the attribute directly. g) False. A destructor exe- 
cutes when the last reference to an object is destroyed. h) False. A shared class attribute should be 
initialized exactly once, at class scope, outside the class’s methods. i) True. j) False. The programmer 
is not required to write a_ dei _method for a class. 

EXERCISES 

7.3 Create a class called Complex for performing arithmetic with complex numbers. Write a 
driver program to test your class. 

Complex numbers have the form 

realPart + imaginaryPart * i 

where i is 


258 

7.2 




Use floating-point numbers to represent the data of the class. Provide a constructor that enables an 
object of this class to be initialized when it is created. The constructor should contain default values 
in case no initializers are provided. Provide methods for each of the following: 

a) Adding two ComplexNumbers: The real parts are added to form the real part of the re¬ 
suit, and the imaginary parts are added to form the imaginary part of the resuit. 

b) Subtracting two ComplexNumbers: The real part of the right operand is subtracted 
from the real part of the left operand to form the real part of the resuit, and the imaginary 
part of the right operand is subtracted from the imaginary part of the left operand to form 
the imaginary part of the resuit. 

c) Printing ComplexNumbers in the form (a, b) , where a is the real part and b is the 
imaginary part. 

7.4 Create a class called RationalNumber for performing arithmetic with fractions. Write a 
driver program to test your class. 
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Use integer variables to represent the data of the class—the numerator and the denominator. 
Provide a constructor that enables an object of this class to be initialized when it is declared. The 
constructor should contain default values, in case no initializers are provided, and should store the 
fraction in reduced form (i.e., the fraction 

2 

4 

would be stored in the object as 1 in the numerator and 2 in the denominator). Provide methods for 
each of the following: 

a) Adding two RationalNumbers. The resuit should be stored in reduced form. 

b) Subtracting two RationalNumbers. The resuit should be stored in reduced form. 

c) Multiplying two RationalNumbers. The resuit should be stored in reduced form. 

d) Dividing two RationalNumbers. The resuit should be stored in reduced form. 

e) Printing RationalNumbers in the form a/b, where a is the numerator and b is the 
denominator. 

f) Printing RationalNumbers in floating-point format. 

7.5 Modify the Time class of Fig. 7.13 to include a tick method that increments the time stored 
in a Time object by one second. The Time object should always remain in a consistent state. Write 
a driver program that tests the tick method. Be sure to test the following cases: 

a) Incrementing into the next minute. 

b) Incrementing into the next hour. 

c) Incrementing into the next day (i.e., 23:59:59 to 0:00:00). 

7.6 Create a class Rectangle. The class has attributes_ length and_ width, each of 

which defaults to 1. It has methods that calculate the perimeter and the area of the rectangle. It 

has set and get methods for both_ length and_ width. The set methods should verify that 

_ length and_ width are each floating-point numbers larger than 0.0 and less than 20.0. Write 

a driver program to test the class. 

7.7 Create a more sophisticated Rectangle class than the one you created in Exercise 7.6. This 
class Stores only the x-y coordinates of the upper left-hand and lower right-hand comers of the rect¬ 
angle. The constructor calls a set function that accepts two tuples of coordinates and verifies that each 
of these is in the first quadrant, with no single x or y coordinate larger than 20.0. Methods calculate 
the length, width, perimeter and area. The length is the larger of the two dimensions. In¬ 
clude a predicate method i sSquar e that determines whether the rectangle is a square. Write a driver 
program to test the class. 

7.8 Create a class TicTacToe that will enable you to write a complete program to play the 
game of tic-tac-toe. The class contains a 3-by-3 double-subscripted list of letters. The constructor 
should initialize the empty board to all zeros. Allow two hurnan players. Wherever the first player 
moves, place an "X" in the specified square; place an "O" wherever the second player moves. Each 
move must be to an empty square. After each move, determine whether the game has been won and 
whether the game is a draw. [Note: If you feel ambitious, modify your program so that the computer 
makes the moves for one of the players automatically. Also, allow the player to choose whether to go 
first or second.] 































pythonhtpl_08.fm Page 260 Monday, December 10, 2001 6:49 PM 






Customizing Classes 


fl& 


Objectives 

• To understand how to write special methods that 
customize a class. 

• To be able to represent an object as a string. 

• To use special methods to customize attribute access. 

• To understand how to redefine (overload) operators to 
work with new classes. 

• To leam when to, and when not to, overload operators. 

• To learn how to overload sequence operations. 

• To learn how to overload mapping operations. 

• To study interesting, customized classes. 

The whole difference between construction and creation is 
exactly this: that a thing constructed can only be loved after 
it is constructed; but a thing created is loved before it exists. 
Gilbert Keith Chesterton, Preface to Dickens, Pickwick 
Papers 

The die is cast. 

Julius Caesar 

Our doctor would never really operate unless it was 
necessary. He was just that way. Ifhe didn ’t need the money, 
he wouldn ’t lay a hand on you. 

Herb Shriner 
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O uti i ne 

8.1 

Introduc tion 

8.2 

Customizing String Repne senta tion: Method str 

8.3 

Customizing Attribute Access 

8.4 

OpeiatorOveiioading 

8.5 

Restrictionson OpeiatorOveiioading 

8.6 

Oveiioading Unary Operators 

8.7 

Oveiioading Bina ry Operators 

8.8 

Oveiioading Built-in Functions 

8.9 

Converting Between Types 

8.10 

Case Sbudy: A Rational Class 

8.11 

Oveiioading Sequence Operations 

8.12 

Case Sudy: A SingleList Class 

8.13 

Oveiioading Mapping Operations 

8.14 

Case Sudy: A SimpleDictionary Class 

Summary • Terminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 


8.1 Introduction 

In Chapter 7, we introduced the basies of Python classes and the notion of abstract data 

types (ADTs). We discussed how methods_ init _and_ dei _exeeute when an ob- 

ject is created and destroyed, respectively. These methods are two examples of the many 
special methods that a class may define. A special method is a method that has a special 
meaning in Python; the Python interpreter calls one of an object’s special methods when 
the client performs a certain operation on the object. For example, when a client creates an 
object of a class, Python invokes the_ init _special method of that class. 

A class author implements special methods to customize the behavior of the class. The 
purpose of customization is to provide the clients of a class with a simple notation for 
manipulating objects of the class. For example, in Chapter 7, manipulations on objects were 
accomplished by sending messages (in the form of method calls) to the objects. This 
method-call notation is cumbersome for certain kinds of classes, especially mathematical 
classes. For such classes, it would be nice to use Python’s rich set of built-in operators and 
statements to manipulate objects. In this chapter, we show how to define special methods 
that enable Python’s operators to work with objects—a process called operator over¬ 
loading. It is straightforward and natural to extend Python with these new capabilities. 
Operator overloading also requires great care, because, when overloading is misused, it can 
make a program difficult to understand. 

Operator + has multiple purposes in Python, for example, integer addition and string con- 
catenation. This is an example of operator overloading. The Python language itself overloads 
operators + and *, among others. These operators perform differently to suit the context in 
integer arithmetic, floating-point arithmetic, string manipulation and other operations. 
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Python enables the programmer to overload most operators to be sensitive to the con- 
text in which they are used. The interpreter takes the appropriate action based on the 
manner in which the operator is used. Some operators are overloaded frequently, especially 
operators like + and The job performed by overloaded operators also can be performed 
by explicit method calls, but operator notation is often clearer. 

In this chapter, we discuss when to use operator overloading and when not to use it. 
We show how to overload operators, and we present complete programs using overloaded 
operators. 

Customization provides other benefits, as well. A class may define special methods 
that cause an object of the class to behave like a list or like a dictionary. A class also may 
define special methods to control how a client accesses object attributes through the dot 
access operator. In this chapter, we introduce the appropriate special methods and create 
classes that implement them. 

8.2 Customizing String Representation: Method_ str 

Python is able to output the built-in data types with the print statement. What if a pro¬ 
grammer wants to define a class whose objects also can be output with the print state¬ 
ment? A Python class can define special method_ str _, to provide an informal (i.e., 

human-readable) string representation of an object of the class. If a client program of the 
class contains the statement 

print objectOfClass 

Python calls the object’s_ str _method and outputs the string returned by that method. 

Figure 8.1 demonstrates how to define special method_ str _to handle data of a user- 

defined telephone number class called PhoneNumber. This program assumes telephone 
numbers are input correctly. 


1 # Fig. 8.1: PhoneNumber.py 

2 # Representation of phone number in USA format: (xxx) xxx-xxxx. 

3 

4 class PhoneNumber: 

5 """Simple class to represent phone number in USA format""" 

6 


7 

def init 

( self, number ) 

: 

8 



L ( XXX ) xxx - xxxx " 11 11 

9 




10 

self.areaCode = number! 

: l # : 

11 

self.exchange = number! 

: l # ; 

12 

self.line 

= number[ : 

] # 4-digit line 

13 




14 

def str ( 

self ): 


15 



entation""" 

16 




17 

return 

% \ 


18 

( self 

.areaCode, self. 

exchange, self.line ) 

19 





Fig. 8.1 String representation—special method_ str _. (Partlof2.) 
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20 def test(): 


21 



22 

# obtain phone number from user 

23 

newNumber = raw input( 


24 


) 

25 



26 

phone = PhoneNumber( newNumber 

) # create PhoneNumber object 

27 

print , 


28 

print phone # invokes phone. 

str () 

29 



30 if 

name = = : 


31 

test () 


Enter 

phone number in the form (123) 

456-7890: 

(800) 

555-1234 


The phone number is: (800) 555-1234 



Fig.8.1 String representation—special method str . (Part2of2.) 







Method_ init _(lines 7-12) accepts a string in the form " (xxx) xxx-xxxx", 

where each x in the string is a digit in the phone number. The method slices the string and 
Stores the pieces of the phone number as attributes. 

Method_ str _(lines 14-18) is a special method that constructs and returns a string 

representation of an object of class PhoneNumber. When the interpreter encounters the 
statement 


print phone 

in line 28, the interpreter executes the statement 


print phone._str_() 


When a program passes a PhoneNumber object to built-in function str or when a pro- 
gram uses a PhoneNumber object with the % string-formatting operator (e.g., " %s" % 
phone), Python also calls method_ str_. 



Common Programming Error 8.1 


Returning a non-string valuefrom method _str_ 


is a fatal, runtime error. 


Function test, (lines 20-28) requests a phone number from the user, creates a new 
PhoneNumber object, and prints the string representation of the object. Recall that when a 
module runs as a stand-alone program (i.e., the user invokes the Python interpreter on the 

module), Python assigns the value "_ main _" to the namespace’s name (stored in built- 

in variable _ name _). Line 31 calls function test, if PhoneNumber. py is executed 

as a stand-alone program. This practice of deftning a driver function and testing a module’s 
namespace to execute the function is employed by many Python modules. The benefit of this 
practice is that a module author can deftne different behaviors for the module, based on the 
context in which the module is used. If another program imports the module, the value of 
_name _will be the module name (e.g., "PhoneNumber"), and the test function does 
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not execute. If the module is executed as a stand-alone program, the value of_ name _is 

"_main _", and the test function executes. In Chapters 10 and 11, we create graphical 

programs that use test functions to display the graphical components we define. 



Good Programming Practice 8.1 

Provide test functions for modules you create, when necessary. These functions help ensure 
that the module works correctly, and they provide additional information to clients of the 
class by demonstrating the ways in which a module’s operations may beperformed. 


8.3 Customizing Attribute Access 

In the previous chapter, we discussed two techniques for a client to access an object’s at- 
tributes. The client can access the attributes directly (through the dot access operator), or 
the class author can give the attributes special names to signify that a client should access 
the attributes through access methods. In this section, we discuss another technique—de- 
fining special methods that customize the behavior of direct attribute access. 

Python provides three special methods (Fig. 8.2) that a class can define to control how 
the dot access operator behaves on objects of the class. This technique of redefining an 
operator’s behavior is called “operator overloading,” a topic we discuss in detail in the next 
several sections. Overloading the dot access operator combines the two attribute access 
techniques we discussed in the previous chapter—a client may access the attributes directly 
(i.e., through the dot access operator), but doing so actually executes code that performs the 
operations of access methods. 

Figure 8.3 contains a modifted definition of class Time, the class we used to explore 
attribute access in the previous chapter. The new definition uses special methods 

_getattr and setattr _to control how a client accesses and modifies an 

object’s attributes. 

Lines 7-13 contain a default constructor for class Time. The constructor simply 
assigns the argument values to the new object’s attributes. If a class defines special method 

_setattr _, Python calls this method every time a program makes an assignment to 

an object’s attribute through the dot operator. Therefore, the statement in line 11 actually 
results in the call 

self._setattr_( , hour ) 


Method 

Desc ription 

delattr 

Executes when a client deletes an attribute (e.g., 

dei anObject.attribute) 

getattr 

Executes when a client accesses an attribute name that cannot be 
located in the objecfs dict attribute (e.g., 

anObject.unfoundName) 

setattr 

Executes when a client assigns a value to an objecfs attribute (e.g., 

anObject.attribute = value) 


Fig. 8.2 Attribute accesscustomization methods. 
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# Fig: 8.3: TimeAccess.py 

# Class Time with customized attribute access. 
class Time: 


def init_( self, hour = , minute = , second = ): 


# each statement invokes _ setattr 

self.hour = hour 
self.minute = minute 
self.second = second 

def setattr_( self, name, value ): 


if name == : 

if <= value < : 

self._dict_[ ] = value 

else : 

raise ValueError, 

elif name == or name == 

if <= value < : 

self._dict_[ + name ] = value 

else : 

raise ValueError, 

( name, value ) 

else : 

self._dict_[ name ] = value 

def _ getattr_( self, name ): 


% value 


% \ 


if name == : 

return self._hour 
elif name == : 

return self._minute 
elif name == : 

return self._second 
else : 

raise AttributeError, name 


def str ( self ) : 


military format 


# attribute access does not call _getattr_ 

return % \ 

( self.hour, self._minute, self._second ) 






Fig.8.3 C ustomized attribute access—class Time. (Part 1 of 2.) 































pythonhtpl_08.fm Page 266 Monday, December 10, 2001 6:49 PM 


266 Customizing Classes 


Chapter 8 



Method_ setattr _ (lines 15-34) contains the error-checking code needed to 

maintain the object’s data in a consistent state. The method accepts three arguments—the 
object reference (self ), the name of the attribute to set and the value to be assigned to the 
attribute. Line 18 tests whether the attribute to be set is named "hour". If so, lines 20-23 
determine whether the specified value falis within the appropriate range. If the value is in 
the appropriate range, line 21 assigns the value to attribute _hour by accessing the appro¬ 
priate key-value pair in the object’s_ dict _attribute; otherwise, lines 22-23 raise an 

exception to indicate an invalid value. 

It is important that method_ setattr _uses an object’s_ dict _attribute to 

set an object’s attributes. If line 21 contained the statement 


self. hour = value 


method_ setattr _would execute again, with the arguments M _hour 11 and value, 

resulting in infinite recursion. Assigning a value through the object’s_ dict _attribute, 

however, does not invoke method_ setattr _, but simply inserts the appropriate key- 

value pair in the object’s_ dict_. 



Common Programming Error 8.2 


In method _ setattr _, assigning a value to an object’s attribute through the dotaccess 

operator results in infinite recursion. Use the object’s dict instead. 


Lines 25-31 of method_ setattr _perform similar tests for when the client 

attempts to assign a value to attributes minute or second. If the specified value falis 
within the appropriate range, the method assigns the value to the object’s attribute (either 
_minute or _second). If the client attempts to assign a value to an attribute other than 
hour, minute or second, line 33 assigns the value to the specified attribute name, to 
preserve Python’s default behavior for adding attributes to an object. 
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Common Programming Error 8.3 



Assigning a value to an object’s attribute, but mistakenly typing the wrong namefor that at¬ 
tribute is a logic error. Python adds a new attribute to the object’s namespace with the in- 
correct name. 


Lines 36-46 contain the definition for method_ getattr _. When a client pro- 

gram contains the expression 

timel .attribute 


as an rvalue (i.e., the right-hand value in an operator expression), Python first looks in 

timel’ s _dict _ attribute for the attribute name. If the attribute name is in 

_dict _, Python simply returns the attribute’s value. If the attribute name is not in the 

object’s_ dict _, Python generates the call 


timel._getattr_( attribute ) 


where attribute is the name of the attribute that the client is attempting to access. The 
method tests for whether the client is attempting to access hour, minute or second and, 
if so, returns the value of the appropriate attribute. Otherwise the method raises an excep- 
tion (line 46). 



The getattr definition for every class should raise the AttributeError excep- 

tion ifthe attribute name cannot befound, to presene Python ’s default behaviorfor locating 
nonexistent attributes. 


The interactive session that follows the class definition in Fig. 8.3 demonstrates the 

benefit of defining special methods_ getattr _and_ setattr _. The client pro- 

gram can access the attributes of an object of class Time in a transparent manner, through 
the dot access operator. The interface to class Time appears identical to the interface we 
presented in the first definition of the class in Chapter 7, but it has the advantage of main- 
taining data in a consistent state. In Chapter 9, Inheritance, we discuss a similar tech- 
nique—called properties —that enables class authors to specify a method that executes 
when a client attempts to access or modify a particular attribute. 



Designers of large systems that require striet access to data should use _ getattr _ and 

_ setattr _ to ensure data integrity. Developers of large systems that use Python 2.2 

can use properties, a more efficient technique to take advantage of the syntax allowed by 

_ getattr _ and _ setattr _. 



8.4 Operator Overioading 

Operators provide programmers with a concise notation for expressing manipulations of 
objects of built-in types. Programmers can also use operators with objects of a class. Al- 
though Python does not allow new operators to be created, it does allow most existing op¬ 
erators to be overloaded such that, when these operators are used with objects of a 
programmer-defined type, the operators have meaning appropriate to the new types. 
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Operator overloading contributes to Python’s extensibility, one ofthe language's most ap- 
pealing qualities. 



Good Programming Practice 8.2 

Use operator overloading when it makes a program clearer than accomplishing the same op¬ 
eratioris with explicit inethod calls. 



Good Programming Practice 8.3 

Avoid excessive or inconsistent use of operator overloading; overloaded operators can make 
a program cryptic and difficult to read. 


Although operator overloading may sound like an exotic capability, most program- 
mers implicitly use overloaded operators regularly. For example, the addition operator (+) 
operates quite differently on integers, floating-point numbers and strings. But addition nev- 
ertheless works fine with variables of these types and other built-in types, because the addi¬ 
tion operator (+) has been overloaded in the Python language itself. 

Operators are overloaded by writing a method definition as you normally would, except 
that the method name corresponds to the Python special method for that operator. For 

example, the method name_ add _overloads the addition operator (+). To use an operator 

on an object of a class, the class must overload (i.e., define a special method for) that operator. 

Overloading is most appropriate for mathematical classes. These often require that a 
substantial set of operators be overloaded to ensure consistency with the way these mathe¬ 
matical classes are handled in the real world. For example, it would be unusual to overload, 
for rational numbers, only addition, because other arithmetic operators also are used com- 
monly with rational numbers. 

Python is an operator-rich language. Python programmers who understand the 
meaning and context of each operator are likely to make reasonable choices when it comes 
to overloading operators for new classes. 

Operator overloading provides the same concise expressions for user-defined classes 
that Python provides with its rich collection of operators for built-in types. However, oper¬ 
ator overloading is not automatic; the programmer must write operator overloading 
methods to perform the desired operations. 

Extreme misuses of overloading are possible, such as overloading operator + to per¬ 
form subtraction-like operations or overloading operator - to perform multiplication-like 
operations. Such non-intuitive uses of overloading make a program extremely difficult to 
comprehend and should be avoided. 



Good Programming Practice 8.4 

Overload operators to perform the same function or similar functions on objects as the op¬ 
erators perform on objects of built-in types. Avoid nonintuitive uses of operators. 


8.5 Restrictioris on Operator Overloading 

Most Python operators and augmented assignment symbols can be overloaded. 1 These are 
shown in Fig. 8.4. 


1. Two operators cannot be overloaded: { } and lambda. [Note: 1 ambda is akeyword that supports 
functional programming—a technique that is beyond the scope of this book.] 
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Common operatorsand augmented assignmentstatEments thatcan be overloaded 


+ 

- 

* 

* * 

/ 

// 

% 
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>> 

& 
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== 
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+ = 
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o, 
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A 

| = 

[] 

() 

. 

\ \ 

in 






Fig. 8.4 Operatoreand augmented assignmentstatementsthatcan be 
overloaded. 


The precedence of an operator cannot be changed by overloading. However, paren¬ 
theses can be used to force the order of evaluation of overloaded operators in an expression. 
The associativity of an operator cannot be changed by overloading. 

It is not possible to change the “arity” of an operator (i.e., the number of operands an 
operator takes)—overloaded unary operators remain unary operators, and overloaded 
binary operators remain binary operators. Operators + and - each have both unary and 
binary versions; these unary and binary versions can be overloaded separately, using dif¬ 
ferent method names. It is not possible to create new operators; only existing operators can 
be overloaded. 


Common Programming Error 8.4 



Attempting to change the “arity” of an operator via operator overloading causes a fatal 
runtime error when the overloaded operator's method executes. 


The meaning of how an operator works on objects of built-in types cannot be changed 
by operator overloading. The programmer cannot, for example, change the meaning of how 
+ adds two integers. Operator overloading works only with objects of user-defined classes 
or with a mixture of an object of a user-defined class and an object of a built-in type. 

Overloading a binary mathematical operator (e.g., +. -, *) automatically overloads the 
operator’s corresponding augmented assignment statement. For example, overloading an 
addition operator to allow statements like 


object2 = object2 + objecti 

implies that the += augmented assignment statement also is overloaded to allow statements 
such as 


object2 += objecti 

Although (in this case) the programmer does not have to define a method to overload the 
+ = assignment statement, such behavior also can be achieved by defining the method ex- 
plicitly for that class. 

Performance Tip 8.1 


Sometimes it is preferable to overload an augmented assignment version of an operator to 
perform the operation "inplace" (i.e., without using extra memory by creating a new object). 
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8.6 Oveiioading Unary Operators 

A unary operator for a class is overloaded as a method that takes only the object reference 
argument (self). When overloading a unary operator (such as ~) as a method, if 
ob j ectl is an object of class Class, when the interpreter encounters the expression 

-objectl 

the interpreter generates the call 
obj ectl. invert () 

The operand objecti is the object for which the Class method_ invert _is in- 

voked. Figure 8.5 lists the unary operators and their corresponding special methods. 


8.7 Oveiioading Binary Operators 

A binary operator or statement for a class is overloaded as a method with two arguments: 
self and other. Later in this chapter, we will overload the + operator to indicate addi- 
tion of two objects of class Rational. When overloading binary operator +, if y and z 

are objects of class Rational, then y + z is treated as if y._add_ ( z ) had been 

written, invoking the_ add _method. If y is not an object of class Rational, but z is 

an object of class Rational, then y + z is treated as if z ._radd_( y ) had been 

written. The method is named_ radd _, because the object for which the method exe- 

cutes appears to the right of the operator. Usually, overloaded binary operator methods cre¬ 
ate and return new objects of their corresponding class. 

When overloading assignment statement += as a Rational method that accepts two 
arguments, if y and z are objects of class Rational, then y += z is treated as if 

y. i add ( z ) had been written, invoking the i add method. The method is 

named_ iadd_ , because the method performs its operations “in-place” (i.e., the 

method uses no extra memory to perform its behaviotj. Usually, this means that the method 
performs any necessary calculations on the object reference argument (self), then returns 
the updated reference. Figure 8.6 lists the binary operators and assignment statements and 
their corresponding special methods. 

What happens if we evaluate the expression y + z or the statement y + = z, and only 
y is an object of class Rational? In both cases, z must be coerced (i.e., converted) to an 
object of class Rational, before the appropriate operator overloading method executes. 
We cover coercion and the special methods that provide coercion behavior in Section 8.9. 



Unary operator 

Special method 

- 

neg 

+ 

_pos_ 


invert 




Fig. 8.5 Unary operatorsand theircorresponding special methods. 
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Binary operator/ 
statement 

Special method 

+ 

add , radd 

- 

sub , rsub 

* 

mul , rmul 

/ 

div , rdiv , truediv (for Python 2.2), 
rtruediv (for Python 2.2) 

// 

floordiv , rfloordiv (for Python version 2.2) 

O, 

O 

mod , rmod 

* * 

pow , rpow 

<< 

lshift , rlshift 

>> 

rshift , rrshift 

& 

and , rand 


xor , rxor 

I 

or , ror 

+ = 

i add 

- = 

i sub 

* = 

imul 

/ = 

idiv , itruediv (for Python version 2.2) 

// = 

ifloordiv (for Python version 2.2) 

O, 

"o — 

imod 

* * = 

ipow 

<< = 

ilshift 

>> = 

irshift 

&= 

i and 

■*= 

ixor 

[ = 

ior 

== 

_ e< 3_ 

! + , <> 

ne 

> 

_gt_ 

< 

_it_ 

> = 

_ge_ 

< = 

le 


Fig. 8.6 Binary operatoisand theircorresponding special methods. 








8.8 Oveiioading Buitt-in Functions 

A class also may define special methods that execute when certain built-in functions are 
called on an object of the class. For example, we may define special method_ abs _for 
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class Rational, to execute when aprogram calls abs ( rationalOb j ect ) to com- 
pute the absolute value of an object of that class. The table in Fig. 8.7 contains a list of com- 
mon built-in functions and the corresponding special methods that the class may define. 

8.9 Converting Between Types 

Most programs process information of a variety of types. Sometimes all the operations 
“stay within a type.” For example, adding (concatenating) a string to a string produces a 
string. But, it is often necessary to convert or coerce data of one type to data of another type. 
This can happen in assignments and in calculations. The interpreter knows how to perform 
certain conversions among built-in types. Programmers can force conversions among built- 
in types by calling the appropriate Python function, such as int or f loat. 

But what about user-defined classes? The interpreter cannot know how to convert 
among user-defined classes and built-in types. The programmer must specify how such 
conversions are to occur with special methods that override the appropriate Python func¬ 
tions. For example, a class can define special method_ int _that overloads the 

behavior of the call int ( anObject ) to return an integer representation of the object. 
The table in Fig. 8.8 lists the special methods that a class may define to implement type 
coercion. Each special method has a corresponding built-in function. 





Built-in Function 

Desc ription 

Special method 

abs (x ) 

Returns the absolute value of x. 

abs 

divmod ( x, y ) 

Returns a tuple that contains the integer 
and remainder components of x % y. 

divmod 

len (x ) 

Returns the length of x (x should be a 
sequence). 

len 

pow ( x, y[, z] ) 

Returns the resuit of x y . With three argu- 
ments, returns (x y ) % z. 

pow 

repr( x ) 

Returns a formal string representation of x 
(i.e., a string from which object x can be 
replicated). 

repr 


Fig. 8.7 C ommon built-in functionsand theircomssponding special methods 


Method 


Desc ription 


coerce 

complex 

float_ 

hex 


Converts two values to the same type. 
Converts object to complex number type. 
Converts object to floating-point number type. 
Converts object to hexidecimal string type. 








Fig.8.8 C oercion methods. (Part 1 of 2.) 
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Method 

Desc ription 

int 

Converts object to integer number type. 

long 

Converts object to long integer number type. 

oct 

Converts object to octal string type. 

str 

Converts object to string type. Also used to obtain informal string rep¬ 
resentation of object (i.e., a string that simply describes object). 


Fig. 8.8 C oerc ion methods. (Part 2 of 2.) 


8.10 Case Sbudy: A Rational Class 

Figure 8.9 illustxates a Rational class. The class uses overloaded numerical operators, 
built-in functions and statements to manipulate rational numbers. A rational number is a 
fraction represented as a numerator (top) and a denominator (bottom). A rational number 
can be positive, negative or zero. Class Rational’s interface includes a default construc¬ 
tor, string representation method, overloaded abs function, equality operators and several 
mathematical operators. The class also defines one method simpli fy that reduces the ra¬ 
tional number. Reducing a rational number is the process of dividing the numerator and de¬ 
nominator by their greatest common divisor, to express the rational number in “simplest 
terms.” The file defines a gcd function, used by class Rational to compute the greatest 
common divisor of two values. 

In the class definition (Fig. 8.9), lines 4—12 define function gcd, which computes the 
greatest common divisor of two values. Class Rational uses this function to simplify the 
rational number. 

The Rational constructor (lines 17-30) takes two arguments— top and bottom— 
that default to 1. If the client attempts to create an object of class Rational with denomi¬ 
nator 0, the constructor raises an exception ( ZeroDivisionError ) to indicate an error 
(lines 21-22). ZeroDivisionError is the name of an exception object that Python places 
in the built-in namespace when the interpreter begins. We discuss this exception and others 
(e.g., IndexErrror, KeyError, etc.) in Chapter 12, Exception Handling. Lines 25-26 
assign the object’s numerator and denominator as the absolute value of the arguments passed 
to the constructor. Lines 27-28 compute and assign the object’s sign to attribute sign. Line 
30 calls method simplify, to reduce the rational number to its simplest form. 


1 # Fig. 8.9: RationalNumber.py 

2 # Definition of class Rational. 

3 

4 def gcd( x, y ): 

5 

6 

while y: 

8 z = x 

9 x = y 

10 y = z % y 


Fig. 8.9 Operatoroverloading— Rational .py. (Part 1 of 4.) 
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11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 
63 


return x 
class Rational: 


def _ init_( self, top = , bottom = ): 


# do not allow 0 denominator 

if bottom == : 

raise ZeroDivisionError, 

# assign attribute values 

self.numerator = abs( top ) 
self.denominator = abs( bottom ) 

self.sign = ( top * bottom ) / ( self.numerator * 
self.denominator ) 


self.simplify() # Rational represented in reduced form 


# class interface method 

def simplify( self ): 


common = gcd( self.numerator, 
self.numerator /= common 
self.denominator /= common 


self.denominator 


) 



# overloaded unary operator 

def _ neg_( self ): 


return Rational( -self.sign * self.numerator, 
self.denominator ) 

# overloaded binary arithmetic operators 

def add_( self, other ): 


return Rational( 

self.sign * self.numerator * other.denominator + 
other.sign * other.numerator * self.denominator, 
self.denominator * other.denominator ) 

def sub_( self, other ): 


return self + ( -other ) 
def mul_( self, other ): 








Fig. 8.9 Operatoroverloading— Rational .py. (Part 2 of 4.) 
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64 

return 

Rational( self.numerator * other.numerator. 

65 



self.sign * self.denominator * 

66 



other.sign * other.denominator ) 

67 




68 

def div 


( self, other ): 

69 




70 




71 

return 

Rational( self.numerator * other.denominator, 

72 



self.sign * self.denominator * 

73 



other.sign * other.numerator ) 

74 




75 

def truediv ( self, other ): 

76 




77 




78 




79 

return 

self. div ( other ) 

80 




81 

# overloaded binary comparison operators 

82 

def eq 

( 

self, other ): 

83 




84 




85 

return 

( 

self - other ).numerator == 

86 




87 

def lt 

( 

self, other ): 

88 




89 




90 

return 

( 

self - other ).sign < 

91 




92 

def gt 

( 

self, other ): 

93 




94 




95 

return 

( 

self - other ).sign > 

96 




97 

def le 

( 

self, other ): 

98 




99 




100 

return 

( 

self < other ) or ( self == other ) 

101 




102 

def ge 

( 

self, other ): 

103 




104 




105 

return 

( 

self > other ) or ( self == other ) 

106 




107 

def ne 

( 

self, other ): 

108 




109 




110 

return 

not ( self == other ) 

111 




112 

# overloaded built-in functions 

113 

def abs 


( self ): 

114 




115 




116 

return 

Rational( self.numerator, self.denominator ) 


Fig. 8.9 Openatoroverloading— Rational .py. (Part 3 of 4.) 
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117 




118 


def str ( self ): 


119 


ii ii ■> string representation" " " 


120 




121 


# determine sign display 


122 


if self.sign == : 


123 


signString = 


124 


else : 


125 


signString = 


126 




127 


if self.numerator == : 


128 


return "0" 


129 


elif self.denominator == : 


130 


return % ( signString, self.numerator ) 

131 


else : 


132 


return % \ 


133 


( signString, self.numerator 

, self.denominator ) 

134 




135 


# overloaded coercion capability 


136 


def int ( self ): 


137 




138 




139 


return self.sign * divmod( self.numerator, 

140 


self.denominator )[ ] 


141 




142 


def float ( self ) : 


143 




144 




145 


return self.sign * float( self.numerator ) / self.denominator 

146 




147 


def coerce ( self, other ): 


148 




149 




150 


if type( other ) == type( ): 


151 


return ( self, Rational ( other 

) ) 

152 


else : 


153 


return None 


Fig. 8.9 

Operatoroverloading— Rational .py. (Part4of 4.) 

1 

# 

Fig. 8.10: fig08 10.py 


2 

# 

Driver for class Rational. 


3 




4 

from RationalNumber import Rational 


5 




6 

# 

create objects of class Rational 


7 

rationali = Rational() 


8 

rational2 = Rational( , ) 

(reduces to 1/3) 

9 

rational3 = Rational( , ) 

(reduces to -1/2) 

10 




11 

# 

print objects of class Rational 


12 

print , rationali 



(«) 


Fig. 8.10 Operatoroverloading—f ig08_10 .py. (Part 1 of 2. 
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13 

print , rational2 


14 

print , rational3 


15 

print 


16 



17 

# test mathematical operators 


18 

print rationali, , rational2, , rationali 

/ rational2 

19 

print rational3, , rational2, , rational3 

- rational2 

20 

print rational2, , rational3, , rationali. 

, \ 

21 

rational2 * rational3 - rationali 


22 



23 

# overloading + implicitly overloads += 


24 

rationali += rational2 * rational3 


25 

print 11 \nrationall after adding rational2 * rati 

, rationali 

26 

print 


27 



28 

# test comparison operators 


29 

print rationali, , rational2, , rationali 

<= rational2 

30 

print rationali, , rational3, , rationali 

> rational3 

31 

print 


32 



33 

# test built-in function abs 


34 

print , rational3, , 

abs( rational3 ) 

35 

print 


36 



37 

# test coercion 


38 

print rational2, , int ( rational2 ) 

39 

print rational2, , float( rational2 ) 

40 

print rational2, , rational2 + 


rationali: 1 
rational2: 1/3 
rational3: -1/2 


1 / 

1/3 = 3 


-1/2 - 1/3 = -5/6 


1/3 

* -1/2 - 1 = -7/6 


rationali after adding rational2 * rational3: 5/6 


5/6 

<= 1/3 : 0 


5/6 

> -1/2 : 1 


The 

absolute value of -1/2 is: 1/2 


1/3 

as an integer is: 0 


1/3 

as a float is: 0.333333333333 


1/3 

+ 1 = 4/3 



Fig. 8.10 Operatoroverloading— f ig08_10 .py. (Part 2 of 2. 


Method simplify (lines 33-38) reduces an object of class Rational. The method 
first calls function gcd to determine the greatest common divisor of the object’s numerator 
and denominator (line 36). The method then uses the greatest common divisor to simplify 
the rational object (lines 37-38). 
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Method_neg_(lines 41-45) overloads the unary negation operator. If rational 

is an object of class Rational, when the interpreter encounters the expression 

-rational 

the interpreter generates method call 

rational. neg () 

which simply creates a new object of class Rational with the negated sign of the original 
object. 

Method_add_(lines 48-54) overloads the addition operator. This method takes 

two arguments—the object reference (self), and a reference to another object of class 

Rational. If rationali and rational2 are two objects of class Rational, when 
the interpreter encounters the expression 

rationali + rational2 

the interpreter generates method call 

rationali._add_( rational2 ) 

This method creates and returns a new object of class Rational that represents the results 
of adding sel f to other. The numerator of this new value is computed with the expression 

self.sign * self.numerator * other.denominator + 
other.sign * other.numerator * self.denominator 

and the denominator is computed with the expression 

self.denominator * other.denominator 

Method _sub_(lines 56-59) overloads the binary subtraction operator. This 

method uses the overloaded + and - operators to create and return the results of subtracting 
the method’ s second argument from the method’ s first argument. 

Method_mul_(lines 61-66) overloads the binary multiplication operator. This 

method creates and returns a new object of class Rational that represents the product of 
the method’s two arguments. 

Method_div_(lines 68-73) overloads the binary division operator / and creates 

and returns a new object of class Rational that represents the results of dividing the 
method’s two arguments. Method_truediv_(lines 75-79) overloads the binary divi¬ 

sion operator / for Python versions 2.2 and greater that use floating-point division. This 

method simply calls method_div_, because the / operator should perform the same 

operation, regardless of the Python version. [Note: See Chapter 2, Introduction to Python 
Programming, for more information on the difference in the / operator between Python 
versions.] 

Method_eq_ (lines 82-85) overloads the binary equality operator (==). If 

rationali and rational2 are two objects of class Rational, when the interpreter 
encounters the expression 

rationali == rational2 
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the interpreter generates method call 

rationali._eq_( rational2 ) 

This method subtracts the two objects and determines whether the numerator of the resuit 
is 0. Rational objects are reduced to their simplest form when created; therefore, we do 
not need to reduce the method’ s argument values before testing whether they are equal. 

Method _lt_ (lines 87-90) overloads the binary less-than operator (<). This 

method subtracts its second argument from its first argument and tests whether the sign of 

the resuit is less than 0. Method_gt_(lines 92-95) overloads the binary greater-than 

operator (>). This method subtracts its second argument from its first and tests whether the 
sign of the resuit is greater than 0. 

Methods_le (lines 97-100), ge (lines 102-105) and ne (lines 107- 

110) overload the <=, >= and inequality operators (! = and <>) for objects of class 
Rational. These methods use the overloaded equality (==), greater-than (>) and less- 
than (<) operators to performs their operations. 

Lines 113-116 define special method_abs_to overload the functionality of the 

built-in abs function. If rational is an object of class Rational, when the interpreter 
encounters the expression 

abs( rational ) 

the interpreter generates the method call 

rational._abs_() 

This method creates a new object of class Rational using the values of the numerator 
and denominator of the object reference argument (recall that the constructor Stores these 
values as positive integers). 

Lines 118-133 define method_str_so that clients may use the print statement 

or built-in function str to display information about an object of class Rational. If the 

object’ s numerator is 0, s t r returns the string representation of integer value 0; if the 

object’s denominator is 1,_str_returns the string representation of the object’s sign 

and numerator. Otherwise, the method returns the string representation of the object’s sign, 
followed by the string representation of the object’ s numerator, followed by " / ", followed 
by the string representation of the object’s denominator. 

Lines 136-153 define special methods for coercion behavior. Method_int (lines 

136-140) executes when a client invokes built-in function int on an object of class 
Rational. The method calls built-in function divmod to compute the integer division 
and remainder components of dividing the numerator by the denominator. The method 
returns the first element in the tuple returned from divmod, which represents the integer 

division component. Method_f loat_(lines 142-145) executes when a client invokes 

built-in function float on an object of class Rational. The method multiplies the 
object’s sign (-1 or 1) by the resuit of dividing the numerator by the denominator and 
ensures a floating-point return value by call function float on the numerator. 

Method_coerce_(lines 147-153) executes when a client calls built-in function 

coerce on an object of class Rational and another object or when the client performs 
so-called “mixed-mode” arithmetic. An example of mixed-mode arithmetic is the statement 


rational + 
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which attempts to add an integer to an object of class Rational. This statement results in 
the method call 

rational._add_( rational._coerce_( ) ) 

Special method_coerce_should contain code that converts the object and the other 

type to the same type and should return a tuple that contains the two converted values. 
Method_coerce_for class Rational converts only integer values. Line 150 deter¬ 

mines whether the type of the method’s second argument is an integer. If so, the method 
returns a tuple that contains the object reference argument and a new object of class Ra¬ 
tional, created by passing the integer argument to Rational’s constructor. Python ex- 

pects special method_coerce_to return None if a coercion of the two types is not 

possible; therefore, line 153 returns None if the method’s argument is not an integer. 

The driver program (Fig. 8.10) creates objects of class Rational—rationali is 
initialized by default to 1/1, rational2 is initialized to 10/30 and rational3, which 
is initialized to -7/14. The Rational constructor calls method simplify to reduce the 
specified numerator and denominator. Thus, rational2 represents the value 1/3, and 
rational3 represents the value -1/2. 

The driver program outputs each of the constructed objects of class Rational, using 
the print statement. Lines 17-21 demonstrate the results of using overloaded arithmetic 
operators /, - and *. Lines 24—26 demonstrate that overloading the + addition operator 
implicitly overloads the += assignment statement. The program uses the += augmented 
assignment statement to add to rationali theproductof rational2 * rational3, 
then prints the results. The driver then prints the results of comparing the objects of class 
Rational through the overloaded comparison operators (lines 29-31). Line 34 prints the 
absolute value of object rational3. Lines 38-40 tests Rational’s coercion capability 

by printing the integer representation (invoking method_int_) and the floating-point 

representation (invoking method_float_) and by adding an object of class 

Rational and an integer (invoking method_coerce_). 

8.11 OveHoading Sequence Operatioris 

We have seen how to use special methods to define a class that behaves like a numeric type. 
A class also can define several special methods to implement sequence operations, provid- 
ing a list-based interface to its clients. An object of the class can provide access to its ele- 
ments through subscripts and slices, can be passed to function len to determine its length 
and can support the operators and provide the methods that lists support. The table in 
Fig. 8.11 contains some methods that a sequence class should provide. In the next section, 
we define several of these methods for a list-based class that contains only unique values. 


Method 

Desc ription 

add , radd , 

i add 

Overloads addition operator for concatenating sequences 
(e.g., sequencel + sequence2) 


Fig. 8.11 Sequence methods. (Part 1 of 2.) 
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Method 

Desc ription 

append 

Called to append an element to a mutable sequence 
(e.g., sequence. append ( element )) 

contains 

Called to test for membership 
(e.g., element in sequence) 

count 

Called to determine number of occurrences of element in a 
mutable sequence (e.g., sequence. count ( element )) 

delitem 

Called to delete an item from a mutable sequence 
(e.g., dei sequence [ index ] ) 

getitem 

Called for subscript access (e.g., sequence [ index ] ) 

index 

Called to obtain index of first occurrence of an element in a 
mutable sequence (e.g., sequence. index ( element )) 

insert 

Called to insert an element at a given index in a mutable 
sequence (e.g., sequence. insert ( index, element )) 

len 

Called for length of sequence (e.g., len ( sequence )) 

mul , rmul , 

Overloads multiplication operator for repeating sequences 

imul 

(e.g.. sequence * 3) 

pop 

Called to remove an element from a mutable sequence 
(e.g.. sequence .pop ()) 

remove 

Called to remove first occurrence of a value from a mutable 
sequence (e.g., sequence. remove ()) 

reverse 

Called to reverse a mutable sequence in place 
(e.g., sequence. reverse ()) 

setitem 

Called for assignment to a mutable sequence 
(e.g., sequence [ index ] = value) 

sort 

Called to sort a mutable sequence in place 
(e.g., sequence. sort ()) 


Fig. 8.11 Sequence methods. (Part2of 2.) 



8.12 Case Sbudy: A SingleList Class 

We now present an example of a class that “wraps” (contains) a list to illustrate how to de- 
fine several special methods to create a class that behaves like a sequence. The list allows 
clients to insert only new (unique) values in the list and allows the list to be displayed in 
tabular form. This example will sharpen your appreciation of data abstraction. You will 
probably want to suggest enhancements to this example. Class development is an interest- 
ing, Creative and intellectually challenging activity—always with the goal of “crafting 
valuable classes.” 

The program of Fig. 8.12 demonstrates class SingleList and its overloaded oper- 
ators, statements and other special methods. First we walk through the driver program 
(Fig. 8.13). Then we consider the class definition and each of the class’s methods. 
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1 
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6 
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10 

11 

12 

13 
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17 
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19 
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22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 


# Fig. 8.12: NewList.py 

# Simple class SingleList. 

class SingleList: 

def _ init_( self, initialList = None ): 

. .Initializes SingleList instance""" 

self._list = [] # internal list, contains no duplicates 

# process list passed to _init_, if necessary 

if initialList: 

for value in initialList: 

if value not in self._list: 

self._list.append( value ) 

# string representation method 

def str ( self ) : 


tempString = 
i = 


# build output string 

for i in range( len( self ) ): 

tempString += % self._list[ i 


] 



if ( i + ) % == : #4 numbers per row of output 

tempString += 


if i % 4 1= 0: # add newline, if necessary 

tempString += 


return tempString 


# overloaded sequence methods 

def len ( self ): 


return len( self._list ) 

def _ getitem_( self, index ): 

a n ii Overloaded sequence element access 

return self._list[ index ] 

def setitem_( self, index, value ): 


Fig. 8.12 SingleList classwithoperatoroverloading— SingleList .py. (Part 
1 of 2.) 
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52 

if value in self. list: 


53 

raise ValueError, \ 


54 


% str( value ) 

55 



56 

self. list [ index ] = value 


57 



58 

# overloaded equality operators 


59 

def eq ( self, other ): 


60 



61 



62 

if len( self ) != len( other ): 


63 

return 0 # lists of different sizes 

64 



65 

for i in range( , len( self ) ) 

: 

66 



67 

if self. list [ i ] != other. 

list [ i ] : 

68 

return 0 # lists are not 

equal 

69 



70 

return # lists are equal 


71 



72 

def ne ( self, other ): 


73 



74 



75 

return not ( self == other ) 



Fig. 8.12 SingleList classwith operatoroverloading— SingleList .py. (Part 
2 of 2.) 


1 # Fig. 8.13: fig08 13.py 

2 # Driver for simple class SingleList. 

3 

4 from NewList import SingleList 

5 

6 def getlntegers(): 

size = int( rawinput( ) ) 

8 

9 returnList = [] i; thc list to return 

10 

11 for i in range( size ): 

12 returnList.append( 

13 int( raw_input( % ( i + ) ) ) ) 

14 

15 return returnList 

16 

17 # input and create integersl and integers2 

18 print "Creating integersl, ," 

19 integersl = SingleList( getlntegers() ) 

20 

21 print "Creating integers2..." 

22 integers2 = SingleList( getlntegers() ) 

23 


Fig. 8.13 SingleList classwith operatoroverloading— fig08_13 .py. (Part 1 
of 3.) 
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24 # print integersl size and contents 

25 print "\nSize of list integersl is", len( integersl ) 

26 print , integersl 

27 

28 # print integers2 size and contents 

29 print "\nSize of list integers2 is", len( integers2 ) 

30 print , integers2 

31 

32 # use overloaded comparison operator 

33 print "Evaluating: integersl != integers2" 

34 

35 if integersl != integers2: 

36 print ;y ara not equal" 

37 

38 print " \nEvaluating : integersl == integers2" 

39 

40 if integersl == integers2: 

41 print They are equal" 

42 

43 print "integersl [ 0 ] is", integersl[ 0 ] 

44 print "Assigning 0 to integersl [ 

45 integersl[ ] = 

46 print , integersl 




Fig. 8.13 SingleList classwith operatoroverloading— f ig08_13 .py. (Part 2 
of 3.) 
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Fig. 8.13 SingleList classwith operatoroverloading— f ig08_13 .py. (Part 3 
of 3.) 


The program (Fig. 8.13) begins by creating two objects of class SingleList (lines 
18-22). This class’s constructor takes a list as an argument. To create this list, we call func- 
tion getlntegers (lines 6-15). This function prompts the user to enter integers and 
returns a list of these integers. Lines 25-26 use overloaded Python function len to deter- 
mine the size of integersl and use the print statement (which implicitly calls method 

_str_ ) to confirm that the list elements were initialized correctly by the constructor. 

Next, lines 29-30 output the size and contents of integers2. 

Lines 35—41 test the overloaded equality operator (==) and inequality operator (! =) by 
first evaluating the condition 

integersl != integers2 

The program prints a message if the two objects are not equal (line 36). Similarly, line 41 
prints a message if the two objects are identical. 

Line 43 uses the overloaded subscript operator to refer to integersl [ 0 ]. This 
subscripted name is used as an rvalue to print the value in integersl [ 0 ]. Line 45 uses 
integersl [ 0 ] as an Ivalue on the left side of an assignment statement to assign a new 
value, 0, to element 0 of integersl. 

Now that we have seen how this program operates, let us walk through the class’s 
method definitions (Fig. 8.12). Lines 6-17 define the constructor for the class. The con¬ 
structor initializes attribute _list to be the empty list. If the user specifted a value for 
parameter initialList, the constructor inserts ali unique elements from initial- 
List into _list. 

Lines 20-36 define method_ str _for representing objects of class Integer- 

List as a string. This method builds a string (tempString) by iterating over the ele¬ 
ments in the list and formatting the elements in tabular format, with four elements in each 
row. Line 36 returns the formatted string. 

Lines 39-42 define method_ len _, which overrides the Python len function. 

When the interpreter encounters the expression 
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len( integersl ) 

in the driver program, the interpreter generates the call 
integersl._len_() 

This method simply returns the length of attribute_list. 

Lines 44-56 define two overloaded subscript operators for the class. When the inter¬ 
preter encounters the expression 

integersl[ ] 

in the driver program, the interpreter invokes the appropriate method by generating the call 
integersl._getitem_( ) 

to return the value of element 0 fe.g., line 43 in the driver program), or the call 


integersl._setitem_( , value ) 


to set the value of a list element (e.g., line 45 in the driver program). When the [ ] operator 

is used in an rvalue expression, method_ getitem _is called; when the [] operator is 

used in an Ivalue expression, method_ setitem _is called. 

Method_ getitem _(lines 44-47) simply returns the value of the appropriate ele¬ 
ment. Method_ setitem _(lines 49-56) first ascertains whether the list already con- 

tains the new element. If the list contains the new element, the method raises an exception; 
otherwise, the method sets the new value. Because SingleList methods manipulate a 
basic list, any out-of-range errors that apply to regular list data types apply to our Sin¬ 
gleList type. 

Lines 59-70 define the overloaded equality operator (==) for the class. When the inter¬ 
preter encounters the expression 


integersl == integers2 

the interpreter invokes the_ eq _method by generating the call 

integersl._eq_( integers2 ) 

The_ eq _method immediately returns 0 if the length of the lists are different (lines 62- 

63). Otherwise, the method compares each pair of elements (lines 65-68). If they are ali the 
same, the method returns 1 (line 70). The first pair of elements to differ causes the method 

to return 0 immediately (line 68). Line 72-75 define method_ ne _for testing whether 

two NewLists are unequal. The method simply uses the overloaded == operator to deter- 
mine whether the two objects are unequal. 

Class SingleList defines only some of the methods suggested for sequences in 
Fig. 8.11. The exercises contain instructions for implementing some of the remaining 
methods. 


8.13 Oveiioading Mapping Operatioris 

Python defines several special methods to provide a mapping-based interface to its clients. 
An object of a class that implements these methods can provide access to its elements 
through subscripts, can be passed to function len to determine the object’s length (i.e., the 
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number of key-value pairs) and can support the methods that dictionaries support. The ta- 
ble in Fig. 8.14 contains some methods that a mapping class should provide. In the next sec- 
tion, we show an example of a class that defines many of these methods, to provide a 
dictionary interface to a basic object. 

8.14 Case Sbudy: A SimpleDictionary Class 

Recall that an object of a class has a namespace that contains identifiers and their values. 

Attribute_ dict _contains this information for each object. We can take advantage of 

this fact to provide a dictionary interface to every object of a class. Figure 8.15 demon- 
strates class SimpleDictionary, which defines special methods to implement map¬ 
ping behaviors of the class. 


Method 

Desc ription 

ciear 

Called to remove all items from mapping 
(e.g., mapping. ciear ()) 

contains 

Called to test for membership; should return same value as method 
has key (e.g., key in mapping) 

[Note: This is new for Python 2.2 dictionaries.] 

copy 

Called to return a shallow copy of mapping 
(e.g., mapping. copy () ) 

delitem 

Called to delete an item from mapping 
(e.g., dei mapping [ key ] ) 

get 

Called to obtain the value of a key in mapping 
(e.g., mapping. get ( key )) 

getitem 

Called for subscript access through key 
(e.g., mapping [ key ]) 

has key 

Called to determine if mapping contains a key 
(e.g., mapping. has key ( key )) 

items 

Called to obtain a list of key-value pairs in mapping 
(e.g., mapping. items ()) 

keys 

Called to obtain a list of keys in mapping 
(e.g., mapping. keys ()) 

len 

Called for length of mapping 
(e.g., len ( mapping )) 

setitem 

Called for insertion or assignment through key 
(e.g., mapping [ key ] = value) 

values 

Called to return a list of values in mapping 
(e.g., mapping.values()) 

update 

Called to insert items from another mapping 
(e.g., mapping. update ( otherMapping )) 








Fig. 8.14 Mapping methods. 
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1 # Fig. 8.15: NewDictionary.py 

2 # Definition of class SimpleDictionary. 

3 

4 class SimpleDictionary: 

5 .'Class to make an instance behave 

6 

7 # mapping special methods 

def _ getitem_( self, key ): 

9 

10 

11 return self._dict_[ key ] 

12 

13 def _ setitem_( self, key, value ): 

14 

15 

16 self._dict_[ key ] = value 

17 

18 def _ delitem_( self, key ): 

19 .'Overloaded key-value deletion" 

20 

21 dei self._dict_[ key ] 

22 

23 def _ str_( self ) : 

24 '""'Overloaded string representati 

25 

26 return str( self. dict ) 

27 

28 # common mapping methods 

29 def keys( self ): 

30 

31 

32 return self._dict_.keys() 

33 

34 def values( self ): 

35 .Returns list of values in dict 

36 

37 return self._dict_.values() 

38 

39 def items( self ): 

40 

41 

42 return self. dict .items() 


Fig. 8.15 Mapping interface—class SimpleDictionary. 


1 # Fig. 8.16: fig08 16.py 

2 # Driver for class SimpleDictionary. 

3 

4 from NewDictionary import SimpleDictionary 

5 

6 # create and print SimpleDictionary object 

7 simple = SimpleDictionary() 


Fig. 8.16 Mapping interface— f ig08_16 .py. 
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8 

print The em] 

pty dictio 

, simple 

9 

10 

11 

12 

13 

14 

# add values 

simple[ ] = 

simple[ ] = 

simple[ ] = 

print 

to simple 

(invokes simple. setitem ) 

, simple 

15 

16 

dei simple[ 

] # remove a value 

17 

print he di 


, simple 

18 

19 

20 

# use mapping 
print 

methods 

, simple.keys() 

21 

22 

print 

print ictio: 


, simple.values() 

, simple.items() 


The empty dictionary: {} 

The dictionary after adding values: {l: 1 one 1 , 2: 'two', 3: 'three'} 

The dictionary after removing a value: {2: 'two 1 , 3: 'three'} 
Dictionary keys: [2, 3] 

Dictionary values: ['two', 'three'] 

Dictionary items: [(2, 'two'), (3, 'three')] 

Fig.8.16 Mapping interface— f ig08_16 .py. 

Each method in the class (Fig. 8.15) simply calls the appropriate method for the object’s 

_ dict _attribute. Method_ getitem _(lines 8-11) accepts akey argument that con- 

tains the key value to retrieve from the dictionary. Line 11 simply uses the [] operator to 

retrieve the specified key from the object’s_ dict _. Method_ setitem _(lines 13- 

16) accepts as arguments a key and a value. The method simply inserts or updates the key- 

value pair in the object’s_ dict _. Method_ delitem _(lines 18-21) executes when 

the client uses keyword dei to remove a key-value pair from the dictionary. The method 

simply removes the key-value pair from the object’s_ dict _. Method_ str _(lines 

23-26) returns a string representation of an objectof class SimpleDictionary by passing 

the object’s_ dict _to built-in function str. Methods keys (lines 29-32), values 

(lines 34-37) and items (lines 39—42) each return their appropriate value by calling the 
corresponding method on the object’s_ dict _. 

The driver program (Fig. 8.16) creates one object of class SimpleDictionary and 
uses the print statement to output the object’s value (lines 7-8). Lines 11-13 add new 

values to the object with the [] operator, invoking method simple._setitem_. 

Line 16 uses keyword dei to delete an element from the object, invoking method 

object._delitem_. Lines 20-22 call methods keys, values and items, to 

print the key-value pairs that the object Stores. 

In this chapter, we introduced the concept of class customization, wherein a class 
defines certain special methods to provide a syntax-based interface. These special methods 
perform a wide variety of tasks in Python, including string representation, attribute access, 
operator oveiioading and subscript access. We discussed the methods that provide each of 
these behaviors, and implemented three case studies that demonstrated how these methods 
can be used. In the next chapter, we discuss inheritance, a feature that allows programmers 
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to define new classes that take advantage of the attributes and behaviors of existing classes. 
This ability is a key advantage of object-oriented programming, because it lets program- 
mers focus only on the new behaviors a class should exhibit. For example, the technique 
we employed in this chapter of implementing a dictionary interface by calling the methods 

of an object’s underlying_dict_attribute leads to some amount of redundant code. 

With inheritance, we can define a class that “re-uses” the behaviors of the Standard dictio¬ 
nary type, without having to define every mapping method explicitly. 

SUMMARY 

• A special method is a method that has a special meaning in Python; the Python interpreter calls 
one of an object’s special methods when the client performs a certain operation on the object. 

• A class author implements special methods to customize the behavior of the class. The purpose of 
customization is to provide the clients of a class with a simple notation for manipulating objects 
of the class. 

• Operator overloading consists of defining special methods to describe how operators behave with 
objects of programmer-defined types. 

• Python enables programmers to overload most operators to be sensitive to the context in which they 
are used. The interpreter takes the action appropriate for the manner in which the operator is used. 

• A Python class can define special method_str_, to provide an informal (i.e., human-read- 

able) string representation of an object of the class. This method executes when a client uses an 
object with the print statement, the % string formatting operator or built-in function str. 

• Python provides three special methods— getattr_, _setattr_ and 

_delattr —that a class can define to control how the dot access operator behaves on objects 

of the class. 

• If a class defines special method_setattr_, Python calls this method every time a program 

makes an assignment to an object’s attribute through the dot operator. 

• Assigning a value through the object’s _dict_ attribute does not invoke method 

_setattr_, but simply inserts the appropriate key-value pair in the object’s_dict_. 

• When a client program accesses an object attribute as an rvalue, Python first looks in the objecfs 

_dict_attribute for the attribute name. If the attribute name is not in_dict_, Python in- 

vokes the objecfs_getattr_method. 

• The_getattr_definition for every class should raise the AttributeError exception if 

the attribute name cannot be found, to preserve Python’s default behavior for looking up nonex- 
istent attributes. 

• Although Python does not allow new operators to be created, it does allow most existing operators 
to be overloaded so that, when these operators are used with objects of a programmer-defined type, 
the operators ha ve meaning appropriate to the new types. 

• Operators are overloaded by writing a method definition as you normally would, except that the 
method name corresponds to the Python special method for that operator. To use an operator on 
an object of a class, the class must overload (i.e., define a special method for) that operator. 

• Operator overloading is not automatic; the programmer must write operator-overloading methods 
to perform the desired operations. 

• The precedence of an operator cannot be changed by overloading. 

• It is not possible to change the “arity” of an operator (i.e., the number of operands an operator 
takes): Overloaded unary operators remain unary operators; overloaded binary operators remain 
binary operators. 
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• The meaning of how an operator works on objects of built-in types cannot be changed by operator 
overloading. Operator overloading works only with objects of user-defined classes or with a mix¬ 
ture of an object of a user-defined class and an object of a built-in type. 

• Overloading a binary mathematical operator automatically overloads the operator’ s corresponding 
augmented assignment statement, although the programmer can overload the augmented assign- 
ment statement explicitly. 

• A unary operator for a class is overloaded as a method that takes only the object reference argu- 
ment (self). 

• A binary operator or statement for a class is overloaded as a method with two arguments: sel f, 

and other. 

• A class also may define special methods that execute when certain built-in functions are called on 
an object of the class. 

• The interpreter knows how to perform certain conversions among built-in types. Programmers can 
force conversions among built-in types by calling the appropriate function, such as int or f loat. 

• The programmer must specify how conversions among user-defined classes and built-in types are 
to occur. Such conversions can be performed with special methods that override the appropriate 
Python functions. 

• Method_ truediv _overloads the binary division operator / for Python versions 2.2 and 

greater that use floating-point division. 

• Method_ coerce _executes when a client calls built-in function coerce on an object of class 

Rational and another object or when the client performs so-called “mixed-mode” arithmetic. 

• Special method_ coerce _should contain code that converts the reference object and the other 

type to the same type and should retum a tuple that contains the two converted values. Python expects 
special method_ coerce _to retum None if a coercion of the two types is not possible. 

• A class also can define several special methods to implement sequence operations, providing a list- 
based interface to its clients. 

• When a program accesses an element of a sequence- or dictionary-like object as an nalue, the ob- 

ject’s_ getitem _method executes. When a program assigns a value to an element of a se¬ 
quence- or dictionary-like object, the object’s_ setitem _method executes. 

• Python defines several special methods to provide a mapping-based interface to its clients. 


TERMINOLOGY 


abs _method (overloads built-in 

function abs) 

add _method (overloads operator +) 


count 

_delattr method (overloads 

attribute deletion) 

_delitem method (overloads 

sequence/mapping element deletion) 

_div _method (overloads operator /) 

_divmod _method (overloads built-in 

function divmod) 

_f loat _method (overloads built-in 

function float) 

_f loordiv _method (overloads 

operator //) 


_and _method (overloads operator &) 

“arity” 

append 

binary operator 

ciear 


coerce _method (overloads 

coercion behavior) 

complex _method (overloads 

built-in function complex) 
contains _method (overloads 


get 

_getattr _method (overloads 

attribute retrieval) 


operator in) 

copy 
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_ getitem _method (overloads 

sequence/mapping element retrieval) 

has_key 

_ hex _method (overloads built-in 

function hex) 

_ iadd _method (overloads Symbol + = ) 

_ i and _method (overloads Symbol &=) 

_ idiv _method (overloads Symbol / = ) 

_ if loordiv method (overloads 

Symbol // =) 

_ ilshif t _method (overloads 

Symbol < < =) 

_ imod _method (overloads Symbol %=) 

_ imul _method (overloads Symbol * = ) 

index 

insert 

_ int method (overloads built-in 

function int) 

_ invert _method (overloads operator -) 

_ ior method (overloads Symbol | =) 

_ ipow _method (overloads Symbol **=) 

_ irshif t _method (overloads 

Symbol >> = ) 

_ i sub _method (overloads Symbol - =) 

items 

_ ixor _method (overloads symbol ^ = ) 

keys 

_ len _method (overloads built-in 

function len) 

_ long _method (overloads built-in 

function long) 

_ lshif t _method (overloads operator <<) 

_mod _method (overloads operator %) 

_ mul _method (overloads operator *) 

_neg _method (overloads operator -) 

_oct _method (overloads built-in 

function oct) 
operator overloading 

_ or _method (overloads operator |) 

pop 

_ pos _method (overloads operator +) 

_ pow _method (overloads operator **) 


_ radd _method (overloads 

right-hand addition) 

_ rand _method (overloads 

right-hand bitwise AND) 

_ rdiv _method (overloads 

right-hand division) 
remove 

_ repr _method (formal 

string representation) 

reverse 

_ rf loordiv _method (overloads 

right-hand floor division) 

_ rlshif t _method (overloads 

right-hand left-shift) 

_ rmod _method (overloads 

right-hand modulus) 

_ rmul _method (overloads 

right-hand multiplication) 

_ ror _method (overloads right-hand 

bitwise OR) 

_ rpow _method (overloads 

right-hand exponentiation) 

_ rshif t _method (overloads operator >>) 

_ r rshif t _method (overloads 

right-hand right-shift) 

_ rsub _method (overloads 

right-hand subtraction) 

_ rxor _method (overloads 

right-hand bitwise exclusive OR) 

_ setattr _method (overloads 

attribute assignment) 

_ se t item _method (overloads 

sequence/mapping element assignment) 
sort 

special method 

_str _method (informal string 

string representation) 

_sub _method (overloads operator -) 

unary operator 

update 

values 

_xor _method (overloads operator A ) 


SELF-REVIEW EXERCISES 

8.1 Fili in the blanks in each of the foliowing statements: 

a) Special methods_,_and_customize attribute access 

through the dot access operator. 

b) Suppose a and b are integer variables and a program calculates the sum a + b. Now sup- 
pose c and d are string variables and a program performs the concatenation c + d. The 
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two + operators here are clearly being used for different purposes. This is an example of 


c) The method narne_overloads the + operator. 

d) The_,_and_of an operator cannot be changed by over- 

loading. 

e) The print statement implicitly invokes special method_. 

f) Special method_coerce_should retum_if no coercion can be made. 

g) Special method_ne_overloads the_. 

h) Special method_customizes the behavior of built-in function abs. 

i) Special method_overloads the exponentiation operator_. 

j) Special methods _, _ and _ control attribute access 

through the [] subscript operators for list- and dictionary-like types. 

8.2 State whether each of the following is true or false. If false, explain why. 

a) Customization is accomplished by implementing special methods. 

b) Python allows the programmer to create new operators to overload. 

c) Overloading a mathematical operator implicitly overloads its augmented assignment 
counterpart. 

d) User-defined objects can use Python’s implicit operator overloading to get the expected 
results. 

e) A class may overload the operation of the = assignment Symbol. 

f) Unary operators can be overloaded to accept two operands. 

g) Operator overloading cannot change how an operator works with built-in types. 

h) Comparison operators can be overloaded. 

i) Subtraction can be overloaded with either special method_neg_or_sub_. 

j) A class must define special methods to provide a dictionary-like interface. 

ANSWERS TO SELF-REVIEW EXERCISES 

8.1 a)_getattr_, _setattr_, _delattr_. b) operator overloading. 

c) _add_. d) precedence, associativity, “arity.” e)_str_. f) None, g) ! = and <> inequality 

operators. h)_abs_. i)_pow_, **.j)_getitem_,_setitem_,_delitem_. 

8.2 a) True. b) False. Python prohibits the programmer from creating new operators. c) True. 

d) False. To use an operator or a statement on objects, that operator or statement must be overloaded. 

e) False. The assignment Symbol cannot be overloaded. f) False. Unary operators can be overloaded, 

but the number of operands an operator takes cannot be changed. g) True. h) True. i) False. Subtrac¬ 
tion can be overloaded only with_sub_; the unary operator - can be overloaded with method 

_neg_. j) False. A class may define special methods to provide a dictionary-like interface, but 

may also use inheritance. 


EXERCISES 

8.3 The definition for class SimpleDictionary in Fig. 8.15 does not include ali the methods 

suggested for providing a dictionary interface. Review the list of mapping methods in Fig. 8.14, and 
modify the definition for class SimpleDictionary to include definitions for methods ciear, 
copy, get, has_key and update. Each method of class SimpleDictionary should call at¬ 
tribute _ dict _’s conesponding method, passing any necessary arguments. Review the descrip- 

tion of dictionary methods in Section 5.6—the corresponding methods of class 
SimpleDictionary should specify the same arguments and should return the same value. 

8.4 Implement methods append, count, index, insert, pop, remove, reverse and 
sort for class SingleList. Review the description of list methods in Section 5.6—the corre- 
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sponding SingleList methods should specify the same arguments and should return the same val- 
ue. Any new method that modifies the list should ensure that only unique values are inserted. The 
method should raise an exception if the client attempts to insert an existing value. Also, implement 

methods_ delitem _and_ contains _to enable clients to delete list elements with key- 

word dei or perform membership tests with keyword in. 

8.5 Review the Rational class definition (Fig. 8.9) and driver (Fig. 8.10). What happens when 
Python executes the following statement? 

x = + Rational( , ) 

Special methods_ radd_,_rsub _ and so on overload the mathematical operators for a 

user-defined class when an object of that class is used as the right-hand value of an operator. For 
each operator overloaded in Fig. 8.9 (i.e., operators +, *, / and //), add a corresponding method 

for overloading the operator when a Rational appears to the right of that operator. 

8.6 As class Rational is currently implemented, the client may modify the attributes (i.e., 

sign, numerator and denominator) and place the data in an inconsistent state. Modify the def¬ 
inition for class Rational from Exercise 8.5 to include method_ setitem _. If a client at¬ 
tempts to change the numerator or denominator of an object of class Rational,_setitem_ 

determines whether the change affects the sign of the object. If so, the method changes the object’s 
sign and sets the numerator or denominator as the absolute value of the client-specified value. The 

method also should call method simplify to reduce the object. Beware: If_ setitem _assigns 

a value to an attribute through the dot access operator, Python invokes_ setitem _again, result- 

ing in infinite recursion. Make sure the method makes assignments through the object’s_ dict _ 

attribute instead. [Note: Methods_ init _and simplify also must be updated to use the ob- 

ject’s_ dict _, to avoid infinite recursion]. 

8.7 Consider a class Complex that simulates the built-in complex data type. The class enables 
operations on so-called complex numbers. These are numbers of the form realPart + imagi- 
naryPart * i, where i has the value 




a) Modify the class to enable output of complex numbers in the form ( realPart , imaginary- 

Parti), through the overloaded_ str _method. 

b) Overload the multiplication operator to enable multiplication of two complex numbers as 
in algebra, using the equation 

(a, b;') * (c, di) = (a*c - b*d, (a*d + b*c)i) 

c) Overload the == operator to allow comparisons of complex numbers. [Note: (a, b/) is 
equal to (c, di) if a is equal to c and b is equal to d.] 
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# Exercise 8.7: Complex.py 

# Complex number class. 

class Complex: 


def _ init_( self, real = , imaginary = ): 


self.realPart = real 
self.imaginaryPart = 


imaginary 
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def _ add_( self, other ) : 


real = self.realPart + other.realPart 

imaginary = self.imaginaryPart + other.imaginaryPart 

# create and return new complexNumber 

return Complex( real, imaginary ) 

def sub_( self, other ): 


real = self.realPart - other.realPart 

imaginary = self.imaginaryPart - other.imaginaryPart 

# create and return new complexNumber 

return Complex( real, imaginary ) 




8.8 Develop class Polynomial. The intemal representation of a Polynomial is a dictionary 
of terms. Each term is a key-value pair that contains an exponent and a coefficient. The term 
2x 4 


has the coefficient 2 and the exponent 4. For simplicity, assume the polynomial contains only nonne- 
gative exponents. Develop the class with a dictionary-based interface for accessing terms that 
includes the following elements: 

a) The class’s constructor accepts a dictionary of exponent-, coefficient pairs. 

Coefficient values in a Polynomial are accessed by exponent keys 
(e.g., polynomial [ exponent ] = coefficient). If a polynomial does not 
have a coefficient for a specified exponent, the expression 
polynomial [ exponent ] evaluates to 0. 

The length of a Polynomial is the value of its highest exponent. 

Define method_ str _for representing a Polynomial as a string with terms of the 


b) 


c) 

d) 


form cx y . 

e) Include an overloaded addition operator (+) to add two Polynomials. 

f) Include an overloaded subtraction operator (-) to subtract two Polynomials. 
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Objectives 

• To create new classes by inheriting from existing 
classes. 

• To understand how inheritance promote s Software 
reusability. 

• To understand the notions of base class and derived 
class. 

• To understand the concept of polymorphism. 

• To learn about classes that inherit from base-class 

object. 

Say not you know another entirely, till you have divided an 
inheritance with him. 

Johann Kasper Lavater 

This method is to define as the number ofa class the class of 
all classes similar to the given class. 

Bertrand Russell 

A deck ofcards was built like the purest of hierarchies, with 
every card a master to those below it, a lackey to those above 
it. 

Ely Culbertson 

Good as it is to inherit a library, it is better to collect one. 
Augustine Birrell 

Save base authority from others’ books. 

William Shakespeare, Love’s Labours Lost 
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9.9 AbsbactBase Classes and Conciete Classes 
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9.12 Classes and Python 2.2 

9.12.1 Static Methods 
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9.12.4 _slots C lass Attribute 

9.12.5 Ftoperties 

Summary • Terminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 

9.1 Introduction 

In this chapter we discuss inheritance —one of the most important capabilities of object- 
oriented programming. Inheritance is a form of Software reusability in which new classes 
are created from existing classes by absorbing their attributes and behaviors, and overriding 
or embellishing these with capabilities the new classes require. Software reusability saves 
time in program development. It encourages programmers to reuse proven and debugged 
high-quality Software, thus reducing problems after a system becomes functional. These are 
exciting possibilities. 

When creating a new class, instead of writing completely new attributes and methods, 
the programmer can designate that the new class is to inherit the attributes and methods of 
a previously defined base class. The new class is referred to as a derived class. Each 
derived class itself can be a base class for some future derived class. With single inherit¬ 
ance, a class is derived from one base class. With multiple inheritance, a derived class 
inherits from several base classes. Single inheritance is straightforward—we show several 
examples that should enable the reader to become proficient quickly. Multiple inheritance 
is beyond the scope this edition—we do not show a live-code example and issue a strong 
caution urging the reader to pursue further study before using this powerful capability. 
Appendix O, Additional Python 2.2 Features, describes new Python 2.2 features that enable 
the programmer to exercise more control over program execution when using multiple 
inheritance in a more manner. 
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A derived class can add attributes and methods of its own, so an object of a derived 
class can be larger than object of that derived-class’s base class. A derived class is more 
specific than its base class and represents a smaller set of objects. With single inheritance, 
the derived class starts out essentially the same as the base class. The real strength of inher¬ 
itance comes from the ability to define in the derived class additions, replacements or 
refinements for the features inherited from the base class. 

With inheritance, every object of a derived class also may be treated as an object of 
that derived class’s base class. We can take advantage of this “derived-class-object-is-a- 
base-class-object” relationship to perform some interesting manipulations. For example, 
we can thread a wide variety of different objects related through inheritance into a list 
where each element of the list is treated as a base-class object. This allows a variety of 
objects to be processed in a general way. As we will see, this capability—called polymor- 
phism —is a key thrust of object-oriented programming (OOP). 

With polymorphism, it is possible to design and implement systems that are more 
easily extensible. Programs can be written to process generically—as base-class objects— 
objects of ali existing classes in a hierarchy. Classes that do not exist during program devel- 
opment can be added with little or no modification to the generic part of the program—as 
long as those classes are part of the hierarchy that is being processed generically. The only 
parts of a program that need modification are those parts that require direct knowledge of 
the particular class that is added to the hierarchy. Polymorphism enables us to write pro¬ 
grams in a general fashion to handle many existing and yet-to-be-specified related classes. 
Inheritance and polymorphism are effective techniques for managing Software complexity. 

Experience in building Software systems indicates that significant portions of the code 
deal with closely related special cases. It becomes difficult in such systems to see the “big 
picture” because the designer and the programmer become preoccupied with the special 
cases. Object-Oriented programming provides several ways of “seeing the forest through 
the trees”—a process called cibstraction. 

We distinguish between “is-a” relationships and “has-a” relationships. “Is a” is 
inheritance. In an “is a” relationship, an object of a derived-class type may also be treated 
as an object of the base-class type. “Has a” is composition (see Fig. 7.18). In a “has a” rela¬ 
tionship, an object has references to one or more objects of other classes as members. 

A derived class can access the attributes and methods of its base class. One problem 
with inheritance is that a derived class can inherit method implementations that it does not 
need to have or should expressly not have. When a base-class method implementation is 
inappropriate for a derived class, that method can be overridden (i.e., redefined) in the 
derived class with an appropriate implementation. 

Perhaps most exciting is the notion that new classes can inherit from classes in existing 
class librciries. Organizations develop their own class libraries and use other libraries avail- 
able worldwide. Eventually, Software will be constructed predominantly from standardized 
reusable components just as hardware is often constructed today. This will help to meet the 
challenges of developing the ever more powerful Software we will need in the future. 

9.2 Inheritance: Base Classes and Derived Classes 

Often an object of one class really “is an” object of another class as well. A rectangle cer- 
tainly is a quadrilateral (as are a square, a parallelogram and a trapezoid). Thus, class 
Rectangle can be said to inherit from class Quadrilateral. In this context, class 
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Quadrilateral is a base class and class Rectangle is a derived class. A rectangle is 
a specific type of quadrilateral, but it is incorrect to claim that a quadrilateral is a rectangle 
(the quadrilateral could, for example, be aparallelogram). Figure 9.1 shows several simple 
inheritance examples. 

Other object-oriented programming languages such as Smalltalk and Java use different 
terminology: In inheritance, the base class is called the superclass and the derived class is 
called the subclass. Because inheritance normally produces derived classes with more fea- 
tures than their base classes, the terms superclass and subclass can be confusing; we avoid 
these terms. 

Inheritance forms tree-like hierarchical structures. A base class exists in a hierarchical 
relationship with its derived classes. A class can certainly exist by itself, but it is when a 
class is used with the mechanism of inheritance that the class becomes either a base class 
that supplies attributes and behaviors to other classes or a derived class that inherits 
attributes and behaviors. 

Let us develop a simple inheritance hierarchy (Fig. 9.2). A typical university commu- 
nity has thousands of people who are community members. These people consist of 
employees, students and alumni. Employees are either faculty members or staff members. 
Faculty members are either administrators (such as deans and department chairpersons) or 
teaching faculty. This yields the inheritance hierarchy shown in Fig. 9.2. Note that some 
administrators also teach classes, so we have used multiple inheritance to form class 
AdministratorTeacher. Because students often work for their universities, and 
because employees often take courses, it would also be reasonable to use multiple inherit¬ 
ance to create a class called EmployeeStudent. 

Another inheritance hierarchy is the Shape hierarchy of Fig. 9.3. A common obser- 
vation among students learning object-oriented programming is that there are abundant 
examples of hierarchies in the real world. It is just that these students are not accustomed 
to categorizing the real world in this manner, so it takes some adjustment in their thinking. 


(«) 


Base class 

Derived classes 

Student 

GraduateStudent 

UndergraduateStudent 

Shape 

Circle 

Triangle 

Rectangle 

Loan 

CarLoan 

HomelmprovementLoan 

MortgageLoan 

Employee 

FacultyMember 

StaffMember 

Account 

CheckingAccount 

SavingsAccount 






Fig. 9.1 Inheritance examples. 
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CommunityMember 



Employee Student Alumnus (single inheritance) 



Faculty Staff (single inheritance) 



Administrator Teacher (single inheritance) 



AdministratorTeacher (multiple inheritance) 


Fig.9.2 Inheritance hierarchy foruniversity community membens. 


Shape 



Fig.9.3 Shape cIasshierarchy. 


Let us consider the syntax for indicating inheritance. To specify that class Two- 
DimensionalShape is derived from class Shape. class TwoDimensionalShape 

typically would be defined as follows: 

class TwoDimensionalShape( Shape ): 

With inheritance, all attributes and methods of the base class are inherited as attributes and 
methods of the derived class. 

A base class may be either a direct base class of a derived class or an indirect base 
class of a derived class. A direct base class of a derived class is explicitly listed inside 
parentheses (()) when the derived class is defined. An indirect base class is not explicitly 
listed when the derived class is defined; rather, the indirect base class is inherited from two 
or more levels up the class hierarchy. In Fig. 9.3, class Circle has a direct base class 
TwoDimensionalShape and an indirect base class Shape. Although the class defini- 
tion for class Circle would list only class TwoDimensionalShape as a base class, 
class Circle would inherit all the attributes and methods of class TwoDimensional¬ 
Shape and of class Shape. 

It is possible to treat base-class objects and derived-class objects similarly; that common- 
ality is expressed in the attributes and behaviors of the base class. Objects of any class derived 
with inheritance from a common base class can all be treated as objects of that base class. In 
Section 9.10, we consider an example in which we can take advantage of this relationship. 
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9.3 Creating Base Classes and Derived Classes 

This section creates an inheritance hierarchy and instantiates objects from the classes in that 
hierarchy. Python provides two built-in functions— issubclass and isinstance — 
that enable us to determine whether one class is derived from another class and whether a 
value is an object of a particular class or of a subclass of that class. We discuss these func¬ 
tions in Fig. 9.4 that demonstrates how to derive one class from another class and that un- 
derscores the fact that a derived-class object “is a” base-class object. In Fig. 9.4, lines 6-13 
show a Point class and constructor definition. Lines 15-28 show a Circle class and 
method definitions. Lines 30-52 contain a driver program. We offer this hierarchy as an ex- 
ample of so-called structurcil inheritance. Although it may not appear to be a natural series 
of “is-a” relationships (i.e., many readers will be uncomfortable with any claim that a circle 
is a point), the fact that we derive Circle from Point makes a Circle a Point in a 
mechanical sense. We find that this example helps the student understand the mechanics of 
inheritance. Later in the chapter, we present a natural example of inheritance. 




1 # Fig 9.4: fig09_04.py 

2 # Derived class inheriting from a base class. 

3 

4 import math 

5 

6 class Point: 

8 

9 def _init_( self, xValue = , yValue = ): 

10 

11 

12 self.x = xValue 

13 self.y = yValue 

14 

15 class Circle( Point ): 

16 .Class that represents a circle""" 

17 

18 def _ init_( self, x = , y = , radiusValue = ): 

19 .Circle constructor takes x and y coordinates of center 

20 point and radius""" 

21 

22 Point._init_( self, x, y ) # call base-class constructor 

23 self.radius = float( radiusValue ) 

24 

25 def area( self ): 

26 

27 

28 return math.pi * self.radius ** 

29 

30 # main program 

31 

32 # examine classes Point and Circle 

33 print , Point._bases_ 

34 print , Circle._bases_ 









Fig.9.4 Derived cIassinheriting from a base class. (Part 1 of 2.) 
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35 

36 # demonstrate class relationships with built-in function issubclass 

37 print , \ 

38 issubclass( Circle, Point ) 

39 print , issubclass ( Point, Circle ) 

40 

41 point = Point( , ) 

42 circle = Circle ( , , ) 

43 

44 # demonstrate object relationship with built-in function isinstance 

45 print , isinstance( circle, Point ) 

46 print , isinstance( point. Circle ) 

47 

48 # print Point and Circle objects 

49 print , point._dict_ 

50 print , circle._dict_ 

51 

52 print , circle.area() 


Point bases: () 

Circle bases: (<class _main_.Point at 0x00767250>,) 

Circle is a subclass of Point: 1 
Point is a subclass of Circle: 0 

circle is a Point object: 1 
point is a Circle object: 0 

point members: 

{'y': 50, 'x': 30} 

circle members: 

{'y': 89, 'x': 120, 'radius': 2.7000000000000002} 

Area of circle: 22.9022104447 


Fig.9.4 Derived class inheriting from a base class. (Part 2 of 2.) 


The constructor for class Point (lines 9-13) takes two arguments that correspond to 
the point’s x- and v-coordinates. Class Circle (lines 15-28) inherits from class Point. 
The parentheses (()) in the first line of the class definition indicate inheritance. The name 
of the base class (Point) is placed inside the parentheses. Class Circle inherits all 
attributes of class Point. This means that class Circle contains the Point members 
(i.e., x and y) as well as the Circle members. 

A derived class inherits the methods defined in its base class, including the base-class 
consttuctor. Often, the derived class overrides the base-class constructor by defining a 

derived-class_ init _method. A derived class overrides a base-class method when the 

derived class defines a method with the same name as a base-class method. The overridden 
derived-class consUuctor usually calls the base-class constructor, to initialize base-class 
attributes before initializing derived-class attributes. Line 22 in the Circle constructor 
calls the base-class consUuctor through an unbound method call. Until now, we have 
invoked only boimd method calls. A bound method call is invoked by accessing the method 
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name through an object (e.g., anOb ject. method ()). We have seen that Python inserts 
the object-reference argument for bound method calls. An unbound method call is invoked 
by accessing the method through its class name and specifically passing an object refer- 

ence. For example, line 22 calls method Point._init _and passes self (an object 

of class Circle) as the object reference. The unbound method call also passes the values 
for x and y so the Point constructor can initialize the Point attributes for the object of 
class Circle. We explore method overriding and bound and unbound method calls fur- 
ther in the next section. After the base-class constructor terminates, control returns to the 
Circle constructor so it can perform any Circle-specific initialization. Line 23 adds a 
new attribute— radius —to Circle’s namespace. 



A derived class (like any class) is not required to define a constructor. Ifa derived class does 
not define a constructor, the class’s base-class constructor executes when the client creates 
a new object of the class. 



Common Programming Error 9.1 

Ifa derived class’s overridden constructor needs to invoke the base-class constructor to ini¬ 
tialize base-class members, the derived-class constructor must invoke the base-class con¬ 
structor explicitly. Failure to call the base-class constructor frotn a derived class often is a 
logic error. 



Common Programming Error 9.2 


Failure to specify an object reference as thefirst argument to an unbound method call is a 
logic error. 


Lines 25-28 define method area for class Circle. This method demonstrates how 
the derived class can define new methods to extend the functionality of the base class. In 
this example, derived class Circle provides extra functionality that computes the area of 
an object of class Circle. 

The driver program in Fig. 9.4 first prints the value of each class’s _ bases_ 

attribute (lines 33-34). Recall from Chapter 7 that each class contains special attributes, 

including_ bases _, which is a tuple that contains references to each of the class’s base 

classes. Notice from the output that Point._bases _is an empty tuple, because 

Point does not inherit from any other class. However, Circle ._bases _is a tuple 

that contains one value—a reference to base-class Point. Lines 37-39 call built-in func- 
tion issubclass to demonstrate that Circle is a subclass of Point, but that Point 
is not a subclass of Circle. Function issubclass takes two arguments that are classes 
and returns true if the first argument is a class that inherits from the second argument (or if 
the first argument is the same class as the second argument). 

Lines 41-42 create point as a reference to an object of class Point and circle as 
a reference to an object of class Circle. Lines 45—46 demonstrate built-in function 
isinstance. This function takes two arguments—an object and a class. If the object 
argument is an object of the type specified by the class argument, or if the object argument 
is an object of a derived class of the type specified by the class argument, function isin¬ 
stance returns 1. Otherwise, the function returns 0. The two calls to function isin¬ 
stance demonstrate that a derived class is an object of its base class (e.g., circle is a 
Point), but the reverse is not true (e.g., point is not a Circle). 
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Common Programming Error 9.3 

Treating a base-class object as a derived-class object can cause runtime errors. A program 
terminates ifthe program attempts to call a derived-class methodfrom a base-class object 
and the base class does not define that method. 


Lines 49-50 print the_ dict _attribute point and circle, respectively. Notice 

from the output that circle’s_dict _contains attributes x and y, initialized in the 

base-class constructor. Line 52 calls circle method area, to demonstrate class 
Circle’s extended functionality. 

In this section, we demonstrated the mechanics of defining base and derived classes 
and discussed bound and unbound methods. This material establishes the foundation we 
need for our deeper treatment of object-oriented programming with inheritance in the 
remainder of this chapter. 







9.4 Oveniding Base-Class Methods in a Derived Class 

A derived class can override a base-class method by supplying a new version of that meth¬ 
od with the same name. When that method is mentioned by name in the derived class, the 
derived-class version is selected. The name of the base class may be used to access the base- 
class version from the derived class by passing the derived-class object in an unbound call 
to the base-class’s method. 


Common Programming Error 9.4 



When a base-class method is overridden in a derived class, it is common to have the derived- 
class version call the base-class version and perfonn some additional work. Not using the 
base-class name to reference (i.e., prepending the base-class name and a dot to) the base- 
class method causes infinite recursion, because the derived-class method actually calls itself. 
This eventually will cause the system to exhaust memorv—afatal error. 


Consider a simplified class Employee. It Stores the employee’s firstName and 
lastName. This information is common to ali employees, including classes derived from 
class Employee. From class Employee, now derive classes HourlyWorker, Piece- 
Worker, Boss and CommissionWorker. The HourlyWorker gets paid by the hour, 
with “time-and-a-half’ for overtime hours in excess of 40 hours per week. The Piece- 
Worker gets paid a fixed rate per item produced—for simplicity, assume this person makes 
only one type of item, so the data members are number of items produced and rate per item. 
The Boss gets a fixed wage per week. The CommissionWorker gets a small fixed weekly 
base salary plus a fixed percentage of that person’s gross sales for the week. For simplicity, 
this and the next section present only class Employee and derived class HourlyWorker. 
In Section 9.10, we present a case study that addresses the entire hierarchy. 

Our next example appears in Fig. 9.5. Lines 4-16 show the Employee class defini- 
tion and Employee methods. Lines 18^-0 show the HourlyWorker class definition 
and HourlyWorker method definitions. Lines 42—49 show a driver program for the 
Employee/HourlyWorker inheritance hierarchy that creates an object of class 

HourlyWorker and invokes its _ str _method implicitly, then explicitly with a 

bound method call, then explicitly with an unbound method call. 

The Employee class definition consists of two attributes (firstName and last¬ 
Name) and two methods (_ init _and_ str _). The constructor receives two argu- 

ments and assigns their values to firstName and lastName. Class HourlyWorker 
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inherits from class Employee. The members of HourlyWorker include attributes 

hours and wage and methods_ init _, getPay and_ str_. 
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28 

29 
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49 


# Fig. 9.5: fig09_05.py 

# Overriding base-class methods. 

class Employee: 


def _ init_( self, first, last ): 


self.firstName = first 
self.lastName = last 

def _str_( self ): 


return % ( self.firstName, self.lastName ) 

class HourlyWorker( Employee ): 

def _ init_( self, first, last, initHours, initWage ): 



Employee._init_( self, first, last ) 

self.hours = float( initHours ) 
self.wage = float ( initWage ) 

def getPay( self ): 


return self.hours * self.wage 
def _str_( self ): 


print "HourlyWorker._str_ is executing""" 

return % \ 

( Employee._str_( self ), self.getPay() ) 

# main program 

hourly = HourlyWorker( , , , ) 

# invoke _str_ method several ways 

print "Calling _str_ several ways..." 

print hourly # invoke _str_ implicitly 

print hourly._str_() # invoke 

print HourlyWorker._str_( hourly ) 








Fig. 9.5 Overriding ba se-c Ia ss method sin a derived class. (Part 1 of 2.) 
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Calling _str_ several ways... 

HourlyWorker._str_ is executing 

Bob Smith is an hourly worker with pay of $400.00 
HourlyWorker. str is executing 

Bob Smith is an hourly worker with pay of $400.00 
HourlyWorker. str is executing 

Bob Smith is an hourly worker with pay of $400.00 


Fig. 9.5 Overriding base-classmethodsin a derived class. (Part2 of 2.) 




The HourlyWorker constructor uses an unbound method call to pass the strings 
f irst and last to the Employee constructor so the base-class attributes can be initial- 
ized, then initializes attributes hours and wage. Method getPay uses attributes hours 
and wage to calculate the salary of the HourlyWorker. 

HourlyWorker method_ str _overrides the Employee _str _method. 

Often, base-class methods are overridden in a derived class to provide more functionality. 
The overridden method sometimes calls the base-class version of the method to perform 

part of the new task. In this example, the derived-class_ str _method calls the base- 

class _ str _method (with an unbound method call on line 40) to output the employee’s 

name. The derived-class_ str _method also outputs the employee’s pay. 

The driver program invokes an hourly object’s_ str _method in three different 

ways. Line 47 simply uses the object in a print statement, which implicitly invokes the 

object’s str method. Line 48 makes an explicit, bound call to the object’s str 

method. Line 49 makes an unbound call to class HourlyWorker’s str method 

and passes hourly as the object reference argument. 


9.5 Software Engineeiing with Inheritance 


We can use inheritance to customize existing Software. We inherit the attributes and behav- 
iors of an existing class, then add attributes and behaviors (or override base-class behav- 
iors) to customize the class to meet our needs. It can be difficult for students to appreciate 
the problems faced by designers and implementors on large-scale Software projects. People 
experienced on such projects will invariably state that a key to improving the Software de- 
velopment process is Software reuse. Object-Oriented programming in general, and Python 
in particular, certainly do this. 

The availability of substantial and useful modules delivers the maximum benefits of 
Software reuse through inheritance. As interest in Python grows, interest in creating useful 
modules also grows. Just as shrink-wrapped Software produced by independent Software 
vendors became an explosive growth industry with the arrival of the personal computer, so, 
too, is the creation and distribution of class libraries. Application designers build their 
applications with these libraries, and library designers are being rewarded by having their 
libraries wrapped with the applications. 



Creating a derived class does not affect its base class's source code; the integrity ofa base 
class is preserved by inheritance. 
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A base class specifies commonality—ali classes derived from a base class inherit the 
capabilities of that base class. In the object-oriented design process, the designer looks for 
commonality and “factors it out” to form desirable base classes. Derived classes are then 
customized beyond the capabilities inherited from the base class. 

In an object-oriented system, classes often are closely related. “Factor out” common attributes 
and behaviors and place these in a base class. Then use inheritance toforin derived classes. 

Just as the designer of non-object-oriented systems seeks to avoid unnecessary prolifer- 
ation of functions, the designer of object-oriented systems should avoid unnecessary prolifer- 
ation of classes. Such a proliferation of classes creates management problems and can hinder 
Software reusability, simply because it is more difficult for a potential reuser of a class to 
locate that class in a large collection. The trade-off is to create fewer classes, each providing 
substantial additional functionality, but such classes might be too rich for certain users. 
Performance Tip 9.1 

If classes produced through inheritance are larger than they need to be, memory and Pro¬ 
cessing resources may be wasted. Inherit from the class “closest” to wliatyou need. 

Note that reading a set of derived-class definitions can be confusing because inherited 
members are not shown, but they are nevertheless present in the derived classes. A similar 
problem can exist in the documentation of derived classes. 

A derived class contains the attributes and behaviors of its base class. A derived class can 
also contain additional attributes and behaviors. 






Modifications to a base class do not require derived classes to change as long as the inter- 
- faces to the base class remain unchanged. 


9.6 Compositiori vs. Inheritance 


We have discussed is-a relationships, which are supported by inheritance. We have also 
discussed has-a relationships (and seen an example in Chapter 7, Object-Based Program¬ 
ming) in which a class may have references to other classes as members. "hassuch relation¬ 
ships create new classes by compositiori of existing classes. For example, given the classes 

Employee, BirthDate and TelephoneNumber, it is improper to say that an 
Employee is a BirthDate or that an Employee is a TelephoneNumber. But it is 

certainly appropriate to say that an Employee has a BirthDate and that an Employee 
has a TelephoneNumber. 



Program modifications to a class that is a member ofanother class do not require the enclos- 
ing class to change as long as the interface to the member class remeans unchanged. 


9.7 "Uses A" and "Knows A" Relationships 

Inheritance and composition each encourage Software reuse by creating new classes that 
have much in common with existing classes. There are other ways to use the Services of 
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classes. Although a person object is not a car and a person object does not contain a car, a 
person object certainly uses a car. A program uses an object simply by calling a method of 
that object through a reference. 

An object can be aware of another object. Knowledge networks frequently have such 
relationships. One object can contain a reference to another object to be aware of that 
object. In this case, one object is said to have a knows a relationship with the other object; 
this is sometimes called an associalion. 

9.8 Case Sbudy: Point; Circle, Cylinder 

Consider a more substantial example using a point, circle, cylinder structural-inheritance 
hierarchy. First we develop and use class Point (Fig. 9.6). Then we present an example 
in which we derive class Circle from class Point (Fig. 9.7). Finally, we present an ex¬ 
ample in which we derive class Cylinder from class Circle (Fig. 9.8). 

Figure 9.6 shows class Point. The constructor (lines 7-11) takes two arguments that 

correspond to the x- and y-coordinates of the point. Method str (lines 13-16) creates 

a string representation of an object of class Point. The driver program in function main 
(lines 19-30) creates an object of class point, prints its x and y attributes, changes the 
value of its attributes and prints the changed point object. 
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# Fig 9.6: PointModule.py 

# Definition and test function for class Point. 


class Point: 


(«) 


represents a. crs ( 


xic point 


def _ init_( self, xValue = , yValue = ): 


self.x = xValue 
self.y = yValue 

def _ str_( self ): 


return % ( self.x, self.y ) 

# main program 

def main(): 

point = Point( 72, : ) # create object of class Point 

# print point attributes 

print , point.x 

print , point.y 

# change point attributes and output new location 

point.x = 
point.y = 

print , point 






Fig. 9.6 CIass Point—PointModule .py. (Part 1 of 2.) 
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31 

32 if _ name 

33 main() 


X coordinate is: 72 
Y coordinate is: 115 

The new location of point is: ( 10, 10 ) 


Fig. 9.6 C Ia ss Point —PointModule .py. (Part 2 of 2.) 

Figure 9.7 demonstrates class Circle, which inherits from class Point (Fig. 9.6). 
Lines 7-26 show the Circle class definition, and lines 29-45 contain the driver program 
for class Circle. Note that, because class Circle inherits from class Point, the inter- 
face to Circle includes the Point methods as well as the Circle method area. 
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# Fig. 9.7: CircleModule.py 

# Definition and test function for class Circle. 


import math 

from PointModule import Point 


class Circle( Point ): 


def _init_( self, x = , y = , radiusValue = ): 

Point._init_( self, x, y ) 

self.radius = float( radiusValue ) 

def area( self ): 


return math.pi * self.radius ** 
def _str_( self ): 


# call base-class _ str _ method 

return % \ 

( Point._str_( self ), self.radius ) 

# main program 

def main(): 

circle = Circle( 57, 43, : ) # create Circle 

# print circle attributes 

print , circle.x 

print , circle.y 

print , circle.radius 








Fig. 9.7 Class Circle—CircleModule .py. (Part 1 of 2.) 
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36 

37 # change circle attributes and print new values 

38 circle.radius = 

39 circle.x = 

40 circle.y = 

41 

42 print 

43 print 

44 

45 print , Point ._ str _( circle ) 

46 

47 if _ name_ == 

48 main() 


X coordinate is: 37 
Y coordinate is: 43 
Radius is: 2.5 

The new location and radius of circle are: Center = (2, 2 ) Radius = 
4.250000 

The area of circle is: 56.75 

circle printed as a Point is: ( 2, 2 ) 


, circle 

% circle.area() 


Fig. 9.7 C Iass Circle—CircleModule .py. (Part 2 of 2. 


(«) 


The driver program creates an object of class Circle, then prints the attributes of the 
object. The driver program then changes the values of the object’s attributes and prints the 
changed object. Line 43 calls circle method area to display the object’s area. Finally, 

line 45 calls Point method_ str _as an unbound method and passes circle as the 

object reference. This call prints the object of class Circle as an object of class Point, 
demonstrating how a derived-class object can be used as a base-class object. 

Our last example reuses the Point and Circle class definitions from Fig. 9.6 and 
Fig. 9.7. Lines 8-32 show the Cylinder class definition, and lines 35-61 are the driver 
program for class Cylinder. Note that class Cylinder inherits from class Circle, so 
the interface to Cylinder includes the Circle methods and Point methods as well as 
the Cylinder methods area (overridden from Circle) and volume. Note that the 
Cylinder constructor invokes the constructor for its direct base class Circle, but not 
its indirect base class Point. Each derived-class constructor is responsible only for calling 
the constructors of that class’s immediate base class. 

The driver program creates an object of class Cylinder (line 38), then prints the 
values of the object’s attributes (lines 41—44). The driver program then changes the values 
of the height, radius and coordinates of the cylinder (lines 47-49) and outputs the results of 
the changes (lines 50-51). Finally, the program makes unbound method calls to the Point 

and Circle_str _methods (lines 57 and 61) to print the object of class Cylinder 

as an object of classes Point and Circle, respectively. 

This example nicely demonstrates inheritance. The reader should now be confident 
with the basies of inheritance. In the remainder of the chapter, we show how to program 
with inheritance hierarchies in a general manner. 
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# Fig. 9.8: CylinderModule.py 

# Definition and test function for class Cylinder. 

import math 

from PointModule import Point 
from CircleModule import Circle 

class Cylinder( Circle ): 


def _ init_( self, x, y, radius, height ): 


radius""" 


Circle._init_( self, x, y, radius ) 

self.height = float( height ) 

def area( self ): 


return * Circle.area ( self ) + \ 

* math.pi * self.radius * self.height 

def volume( self ): 


return Circle.area( self ) * height 
def _str_( self ): 


return % \ 

( Circle._str_( self ), self.height ) 

# main program 

def main(): 

# create object of class Cylinder 

cylinder = Cylinder( , , , ) 

# print Cylinder attributes 

print , cylinder.x 

print , cylinder.y 

print , cylinder.radius 

print , cylinder.height 

# change Cylinder attributes 

cylinder.height = 
cylinder.radius = 
cylinder.x, cylinder.y = , 

print , \ 

cylinder 

print % cylinder.area() 






Fig.9.8 C Iass Cylinder—CylinderModule .py. (Part 1 of 2.) 
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54 



55 

# display the Cylinder as a Point 


56 

print "\ncylinder printed as a Point is 

, \ 

57 

Point._str_( cylinder ) 


58 



59 

# display the Cylinder as a Circle 


60 

print "\ncylinder printed as a Circle i 

, \ 

61 

Circle._str_( cylinder ) 


62 

63 if 

name == : 


64 

main() 


X coordinate is: 12 

Y coordinate is: 23 


Radius 

is: 2.5 


Height 

is: 5.7 


The new points, radius and height of cylinder 

are: Center = ( 2, 2 ) 

Radius 

= 4.250000; Height = 10.000000 


The area of cylinder is: 380.53 


cylinder printed as a Point is: ( 2, 2 ) 


cylinder printed as a Circle is: Center = (2, 

2 ) Radius = 4.250000 


Fig. 9.8 ClassCylinder—CylinderModule .py. (Part 2 of 2.) 


9.9 Abstract Base Classes and Conciete Classes 

When we think of a class as a type, we assume that objects of that type will be created. 
However, there are cases in which it is useful to define classes for which the programmer 
never intends to create any objects. Such classes are called abstract classes. Because these 
are used as base classes in inheritance situations, we normally refer to them as abstract base 
classes. 

We do not create objects of abstract classes. The sole purpose of an abstract class is to 
provide an appropriate base class from which classes may inherit interface and possibly 
implementation. Classes from which objects can be created are called concrete classes. 

We could have an abstract base class TwoDimensionalShape and derive concrete 
classes, such as Square, Circle and Triangle. We could also have an abstract base 
class ThreeDimensionalShape and derive concrete classes such as Cube, Sphere 
and Cylinder. Abstract base classes are too generic to define real objects; we need to be 
more specific before we can think of creating objects. That is what concrete classes do; they 
provide the specifics that make it reasonable to create objects. 

A hierarchy need not contain any abstract classes; but, as we will see, many good object- 
oriented systems have class hierarchies headed by an abstract base class. In some cases, 
abstract classes constitute the top few levels of the hierarchy. A good example of this is a 
shape hierarchy. The hierarchy could be headed by abstract base class Shape. On the next 
level down, we can have two more abstract base classes, namely TwoDimensionalShape 
and ThreeDimensionalShape. The next level down would start defining concrete 
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classes for two-dimensional shapes such as circles and squares and concrete classes for three- 
dimensional shapes such as spheres and cubes. 

9.10 Case Sbudy: Inherrting Interface and Implementation 

Our next example reexamines the Employee hierarchy introduced in Section 9.4. This 
time, we implement the entire class hierarchy, heading it with abstract base class Employ¬ 
ee. The derived classes of Employee are Boss, who gets paid a fixed weekly salary re- 
gardless of the number of hours worked; CommissionWorker, who gets a flat base 
salary plus a percentage of sales; PieceWorker, who gets paid by the number of items 
produced; and HourlyWorker, who gets paid by the hour and receives “time-and-a-half ’ 
overtime pay for hours worked in excess of 40 hours. 

Each concrete Employee class defines method earnings. An earnings method 
call certainly applies generically to ali employees. However, the earnings calculation for 
each employee differs based on the class of the employee. These classes are all derived 
from the base class Employee, so each derived class provides appropriate implementa- 
tions of earnings. To calculate any employee’s earnings, the program simply invokes 
the earnings method on that employee’s object. 

Let us now consider the example (Fig. 9.9). We begin with class Employee (lines 4— 
35). The methods include a constructor that takes the first name and last name as arguments; 

an_ str _method; a utility method _checkPositive that ensures an attribute is ini- 

tialized with a positive value and an abstract method earnings. Method earnings 
simply raises a NotlmplementedError exception when called. [Note: We discuss 
exceptions in Chapter 12, Exception Handling.] Why does earnings raise an exception? 
The answer is that it does not make sense to provide an implementation of this method in the 
Employee class. We cannot calculate the earnings for a generic employee—we first must 
know the type of employee to perform a proper earnings calculation. By raising an exception 
in the body of the method, we ensure that each class that inherits from Employee must over- 
ride method earnings with a more specific definition. The programmer never intends to 
call this method on an object of abstract base class Employee. If a derived class neglects to 
override earnings with an appropriate definition, the abstract method in the base class 
raises an exception when the program attempts to call earnings from the derived class. 
Similar to earnings, the Employee constructor raises an exception if a program attempts 
to create an object of the abstract base class. Lines 11-13 determine whether self is an 
object of class Employee and, if so, raise an appropriate exception. 

Class Boss (lines 37-54) derives from class Employee. The Boss’s methods include 
a constructor (lines 40-44), the overridden earnings method (lines 46-49) and an 

_str method (lines 51-54). The constructor (method init ) takes a first name, a 

last name and a weekly salary as arguments and passes the first and last names to the 
Employee constructor to initialize the f irstName and lastName members of the base- 
class part of the derived-class object. Method earnings performs the Boss-specific earn¬ 
ings calculations. Method str creates a string with the type and name of the employee. 

Class CommissionWorker (lines 56-77) derives from class Employee. The 
methods include a constructor (lines 59-66), the overridden earnings method (lines 68- 

71) and an_ str _method (lines 73-77). The constructor takes a first name, a last name, 

a salary, a commission and a quantity of items sold as arguments and passes the first and 
last names to the Employee constructor. Method earnings performs the 
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CommissionWorker-specific earnings calculations. Method_str_creates a string 

with the type and name of the employee. 
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# Fig 9.9: fig09_09.py 

# Creating a class hierarchy with an abstract base class. 


class Employee: 


mplo\ 


def _ init_( self, first, last ): 

"""Employee constructor, takes first name and last name. 
NOTE: Cannot create object of class Employee.""" 

if self._class_ == Employee: 

raise NotlmplementedError, \ 

"Cannot create object of class Employee" 


self.firstName = first 
self.lastName = last 

def _str_( self ): 


return % ( self.firstName, self.lastName 

def _checkPositive( self, value ): 


) 



if value < : 

raise ValueError, \ 

% value 

else : 

return value 
def earnings( self ) : 


raise NotlmplementedError, 
class Boss ( Employee ) : 

def _ init_( self, first, last, salary ): 

Employee._init_( self, first, last ) 

self.weeklySalary = self._checkPositive( float( salary ) ) 
def earnings( self ): 

return self.weeklySalary 






Fig.9.9 Abstracte Ia ss-ba sed hierarchy. (Part 1 of 3.) 
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def _str_( self ): 

return % ( , Employee._str_( self ) ) 

class CommissionWorker( Employee ): 

def _init_( self, first, last, salary, commission, quantity ): 


Employee._init_( self, first, last ) 

self.salary = self,_checkPositive( float( salary ) ) 

self.commission = self,_checkPositive( float( commission ) ) 

self.quantity = self._checkPositive( quantity ) 

def earnings( self ): 


return self.salary + self.commission 
def _ str_( self ): 

return % ( 

Employee._str_( self ) ) 

class PieceWorker( Employee ): 


* self.quantity 



def _init_( self, first, last, wage, quantity ): 


Employee._init_( self, first, last ) 

self.wagePerPiece = self._checkPositive( float( wage ) ) 
self.quantity = self._checkPositive( quantity ) 

def earnings( self ): 


return self.quantity * self.wagePerPiece 
def _str_( self ): 


return % ( 

Employee._str_( self) ) 


101 class HourlyWorker( Employee ): 

102 'HourlyWorker class, inher 






Fig.9.9 Abstracte Ia ss-ba sed hierarchy. (Part2 of 3.) 
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103 

104 def _init_( self, first, last, wage, hours ): 

105 ' .rst and last 

106 wage per hour and hours worked . 

107 

108 Employee._init_( self, first, last ) 

109 self.wage = self._checkPositive( float( wage ) ) 

110 self.hours = self._checkPositive( float( hours ) ) 

111 

112 def earnings( self ): 

113 

114 

115 if self.hours <= 

116 return self.wage * self.hours 

117 else: 

118 return * self.wage + ( self.hours - ) *\ 

119 self.wage * 

120 

121 def _ str_( self ) : 

122 

123 

124 return % ( , 

125 Employee._str_( self ) ) 

126 

127 # main program 

128 

129 # create list of Employees 

130 employees = [ Boss ( , , ) , 


131 

CommissionWorker( , 

r r t 

132 

PieceWorker( , , 

, ), 

133 

HourlyWorker( , 

, , ) 1 

134 




135 # print Employee and compute earnings 

136 for employee in employees: 

137 print % ( employee, employee.earnings() ) 



Boss : 

John Smith earned $800.00 

Commission Worker: 

Sue Jones earned $650.00 

Piece Worker: 

Bob Lewis earned $500.00 

Hourly Worker: 

Karen Price earned $550.00 


Fig.9.9 Abstract class-based hierarchy. (Part 3 of 3.) 


Class PieceWorker (lines 79-99) derives from class Employee. The methods 
include a constructor (lines 82-88), the overridden earnings method (lines 90-93), and 

an_ str _method (lines 95-99). The constructor takes a first name, a last name, a wage 

per piece and a quantity of items produced as arguments and passes the first and last names 
to the Employee constructor. Method earnings performs the PieceWorker-specific 

earnings calculations. Method_ str _method creates a string with the type and name 

of the employee. 
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Class HourlyWorker (lines 101-125) derives from class Employee. The methods 
include a constructor (lines 104—110), the overridden earnings method (lines 112-119), 

and an_ str _method (lines 121-125). The constructor takes a first name, a last name, 

a wage and the number of hours worked as arguments and passes the first and last names 
to the Employee constructor. Method earnings performs the HourlyWorker-spe- 
cific earnings calculations. 

The driver program is shown in lines 127-137. We create a list of four concrete objects 
of class Employee— an object of class Boss, an object of class CommissionWorker, 
an object of class PieceWorker and an object of class HourlyWorker. Lines 136-137 
iterate over the list of objects of class Employee and call method earnings for each 
object in the list. This technique—generically processing a list of objects of various 
classes—is possible because of Python’s inherent polymorphic behavior, a topic we discuss 
in the next section. 

9.11 Folymorphism 

Python enables polymorpliism —the ability for objects of different classes related by inher¬ 
itance to respond differently to the same message (i.e., method call). The same message 
sent to many different types of objects takes on “many forms”—hence the term polymor- 
phism. If, for example, class Rectangle is derived from class Quadrilateral, then 
a Rectangle is a more specific version of a Quadrilateral. An operation (such as 
calculating the perimeter or the area) that can be performed on an object of class Quadri¬ 
lateral also can be performed on an object of class Rectangle. Python is inherently 
polymorphic because the language is “dynamically typed.” This means that Python deter¬ 
mines at runtime whether an object defines a method or contains an attribute. If so, Python 
calls the appropriate method or accesses the appropriate attribute. Also, Python’s dynamic 
typing enables programs to perform generic processing on objects of classes that are not 
related by inheritance. If the objects in a list ali provide the same operations (e.g., all the 
objects define a certain method), then a program can process a list of those objects generi¬ 
cally. The term polymorphism normally refers to the behavior of objects of classes related 
by inheritance, so we discuss polymorphic behavior in the context of class hierarchies in 
which all the classes in the hierarchy provide a common interface. 

Consider the following example using the Employee base class and Hourly¬ 
Worker derived class of Fig. 9.9. Our Employee base class and HourlyWorker 

derived class each define their own_ str _methods. Calling the_ str _method 

through an Employee reference invokes Employee._str _, and calling the 

_ str _ method through an HourlyWorker reference invokes Hourly¬ 
Worker._str _. The base-class_ str _method also is available to the derived 

class. To call the base-class_ str _method for a derived-class object, the method must 

be called explicitly as follows 

Employee._str_( hourlyReference ) 

This specifies that the base-class_ str _should be called explicitly, using hourly¬ 

Reference as the object reference argument. 

Through polymorphism, one method call can cause different actions to occur 
depending on the class of the object receiving the call. This gives the programmer tremen- 
dous expressive capability. 
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With polymorphism, the programmer can deal in generalities and let the execution-time en- 
vironment concern itselfwith the specifics. The programmer can command a wide variety of 
objects to behave in manners appropriate to those objects without even knowing the types of 
those objects. 



Polymorphism promotes extensibility: Software written to invoke polymorphic behavior is 
written independently ofthe types ofthe objects to which messages are sent. Thus, new types 
of objects that can respond to existing messages can be added into such a system without 
modifying the base system. 



An abstract class defines an interface for the various members ofa class hierarchy. The ab- 
stract class contains methods that will be defined in the derived classes. AII methods in the 
hierarchy can use this same inteiface through polymorphism. 


Let us consider applications of polymorphism. A screen manager needs to display many 
objects of different classes, including new types that will be added to the system even after 
the screen manager is written. The system may need to display various shapes (i.e., base class 
is Shape) such as squares, circles, triangles, rectangles, points, lines and the like (each shape 
class is derived from the base class Shape). The screen manager uses base-class references 
(to Shape) to manage all the objects to be displayed. To draw any object (regardless of the 
level at which that object appears in the inheritance hierarchy), the screen manager simply 
sends a draw message to the object. Method draw has been overridden in each of the derived 
classes. Each object of class Shape knows how to draw itself. The screen manager does not 
have to worry about what type each object is or whether the object is of a type the screen man¬ 
ager has seen before—the screen manager simply telis each object to draw itself. 

Polymorphism is particularly effective for implementing layered Software systems. In 
operating systems, for example, each type of physical device may operate differently from 
the others. Regardless of this, commands to read or write data from and to devices can have 
a certain uniformity. The write message sent to a device-driver object needs to be inter- 
preted specifically in the context of that device driver and how that device driver manipu- 
lates devices of a specific type. However, the write call itself is really no different from the 
write to any other device in the system—it simply places some number of bytes from 
memory onto that device. An object-oriented operating system might use an abstract base 
class to provide an interface appropriate for all device drivers. Then, through inheritance 
from that abstract base class, derived classes are formed that all operate similarly. The capa- 
bilities (i.e., the interface) offered by the device drivers are provided as methods in the 
abstract base class. Implementations of these methods are provided in the derived classes 
that correspond to the specific types of device drivers. 

With polymorphic programming, a program might walk through a Container, such as a 
list of objects from various levels of a class hierarchy. For example, a list of objects of class 
TwoDimensionalShape could contain objects from the derived classes Square, 
Circle, Triangle, Rectangle, Line, etc. Sending a message to draw each object 
in the list would, using polymorphism, draw the correct picture on the screen. This example 
of polymorphic programming highlights the benefits of a naturally polymorphic language 
like Python, for building large, layered systems. 
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9.12 Classes and Python 2.2 

In versions of Python before 2.2, classes and types were two distinet programming ele- 
ments. The differences between types and classes contradicts the notion that classes are 
programmer-defined types. Many Python programmers, as well as the developers of the 
language also disliked the limitations of this needless difference between classes and types. 
For example, because types are not classes, programmers cannot inherit from built-in types 
to take advantage of Python’s high-level data manipulation capabilities provided by lists, 
dictionaries and other objects. 

Beginning with Python 2.2, the nature and behavior of classes will change, to remove 
the difference between types and classes. In ali future 2.x releases, a programmer can dis- 
tinguish between two kinds of classes—so-called “classic” classes that behave in the same 
manner as the classes presented earlier in this chapter and the two preceding chapters, and 
“new” classes that exhibit new behavior. Python 2.2 provides type ob ject to define new 
classes. Any class that directly or indirectly inherits from ob ject exhibits all the behav- 
iors defined for a new class, which include many advanced object-oriented features. The 
remainder of this section overviews some of these features in the context of live-code 
examples. 






9.12.1 Static Methods 

In Python 2.2 all classes (not only classes that inherit from ob ject) can define static meth¬ 
ods. A static method can be called by a client of the class, even if no objects of the class 
exist. Typically, a static method is a utility method of a class that does not require an object 
of the class to exeeute. Figure 9.10 contains an example in which we redefine class Em- 
ployee to provide information about the employee’s working conditions. In this example, 
employees work in a small office—only 10 employees can work in the office comfortably. 
If more than 10 employees are working in the office, it becomes too crowded and the em¬ 
ployees are uncomfortable. Class Employee maintains a class attribute numberOf- 
Employees that Stores the number of objects of class Employee that have been 
instantiated. The class also defines static method isCrowded, which determines whether 
the employees are working in overcrowded conditions. 

Lines 4-58 contain the class Employee definition. The class defines two class 
attributes— numberOf Employees, which is the number of objects of class Employee 
that have been created; and maxEmployees, the maximum number of employees that can 
work in the office comfortably. 

Method isCrowded (lines 10-13) returns true if the number of existing objects of 
class Employee is greater than the maximum number of employees that can work in the 
office comfortably. The method accesses class attributes numberOfEmployees and 
maxEmployees through the class name (Employee). Line 16 specifies that method 
isCrowded is a static method for class Employee. A class designates a method as 
static by passing the method’s name to built-in function statiemethod and binding a 
name to the value returned from the function call. Static methods differ from regular 
methods because, when a program calls a static method, Python does not pass the object- 
reference argument to the method. Therefore, a static method does not specify self as 
the first argument. This allows a static method to be called even if no objects of the class 
exist. 
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1 # Fig. 9.10: EmployeeStatic.py 

2 # Class Employee with a static method. 

3 

4 class Employee: 

5 """Employee class with static method isCrowded""" 

6 

numberOfEmployees = 
maxEmployees = 

9 

10 def isCrowded(): 

11 """Static method returns true if the employees are crowded""" 

12 

13 return Employee.numberOfEmployees > Employee.maxEmployees 

14 

15 # create static method 

16 isCrowded = staticmethod( isCrowded ) 

17 

18 def _ init_( self, firstName, lastName ): 

19 """Employee constructor, takes first name and last name""" 

20 

21 self.first = firstName 

self.last = lastName 

23 Employee.numberOfEmployees += 

24 

25 def _ dei_( self ): 

26 """Employee destructor""" 

27 

28 Employee.numberOfEmployees -= 

29 

30 def _ str_( self ): 

31 """String representation of Employee""" 

32 

33 return % ( self.first, self.last ) 

34 

35 # main program 

36 def main(): 

answers = [ , ] 

38 

39 employeeList = [] # list of objects of class Employee 

40 

41 # call static method using class 

42 print , 

43 print answers[ Employee.isCrowded() ] 

44 

45 print "\nCreating 11 objects of class Employee..." 

46 

47 # create 11 objects of class Employee 

48 for i in range( ): 

49 employeeList.append( Employee( , + str( i ) ) ) 

50 

51 # call static method using object 

52 print , 

53 print answers[ employeeList[ i ].isCrowded() ] 









Fig.9.10 Static methods—class Employee. (Part 1 of 2.) 
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54 

55 print \nRemoving one employee. 

56 dei employeeList[ ] 

57 

58 print , answers[ Employee.isCrowded() ] 

59 

60 if _ name_ == 

61 main() 


Employees 

are 

crowded? 

No 

Creating 

11 objects of 

class Employee... 

Employees 

are 

crowded? 

No 

Employees 

are 

crowded? 

No 

Employees 

are 

crowded? 

No 

Employees 

are 

crowded? 

No 

Employees 

are 

crowded? 

No 

Employees 

are 

crowded? 

No 

Employees 

are 

crowded? 

No 

Employees 

are 

crowded? 

No 

Employees 

are 

crowded? 

No 

Employees 

are 

crowded? 

No 

Employees 

are 

crowded? 

Yes 

Removing 

one employee. 


Employees 

are 

crowded? 

No 


Fig.9.10 Static methods—cIass Employee. (Part2 of 2.) 



Method _ init _ (lines 18-23) takes two arguments that correspond to the 

employee’s first and last name. The method also increments the value of Employee class 

attribute numberOfEmployees. Method_ dei _(lines 25-28) decrements the value 

of Employee class attribute numberOfEmployees. Method_ str _(lines 30-33) 

simply returns a string that contains the employee’s first and last name. 

Static methods can be called either by using the class name in which the method is 
defined or by using the name of an object of that class. Function main (lines 36-58) dem- 
onstrates the ways in which a client program can call a static method. Variable answers 
(line 37) is a list that contains the possible answers (" Yes" or "No") to the question, “Are 
the employees crowded?’’ Line 43 calls static method isCrowded using the class name 
(Employee). The method returns 0, because no objects of the class have been created. 
Lines 48-53 contain a for loop that creates 11 objects of class Employee and adds each 
object to list employeeList. For each object, the program calls static method 
isCrowded using the newest object of that class. The program prints "Yes " in response 
to the eleventh call to isCrowded, because the number of existing Employees (class 
attribute numberOfEmployees) is greater than the maximum number that can work in 
the office comfortably (class attribute maxEmployees). Line 56 deletes one of the 
objects from employeeList, which invokes that object’s destructor. Line 58 calls static 
method isCrowded once more to demonstrate that the number of employees has dropped 
to an acceptable level. 
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Static methods are cruciat in languages like Java which require the programmer to 
place all program code in a class definition. In these languages, programmers often define 
classes that contain only static utility methods. Clients of the class can then call the static 
utility methods, much in the same way the Python programs invoke functions defined in a 
module. In Python, static methods enable programmers to define a class interface more pre- 
cisely. When a method of a class does not require an object of the class to perform its task, 
the programmer designates that method as static. 


9.12.2 Inheriting from Built-in Types 


The goal of the new class behavior is to remove the separation that existed between Python 
types and classes before version 2.2. The type-class unification enables programmers to de¬ 
fine a derived class that inherits from one of Python’s built-in types (e.g., integer, string and 
list) in the same manner that a derived class inherits from any base class. In Python 2.2, the 

interpreter places a reference to each type in the_ builtin _namespace. Figure 9.11 

lists common built-in type names from which a programmer-defined class can inherit. A 
programmer-defined class inherits from a built-in type by placing the type’s name in the 
class’s base-class list. 

Figure 9.12 redefines class SingleList —from Section 8.12—a list that contains 
only unique values. The previous definition of SingleList (Chapter 8) defined every 
method for class SingleList that should be exposed to the client. In this example, 
SingleList inherits from base-class list and overrides only those methods that 
should provide customized behaviors in class SingleList. The class inherits the other 
methods of base-class list, so the programmer does not need to define the remaining 
list methods to include them as part of the new class’s interface. 

Class SingleList (Fig. 9.12) inherits from base-class list by placing the name 
list in the parentheses that follow the class name. Every built-in type (except object) 
inherits from object, so classes that inherit from built-in types (including SingleList) 


lype name 

Python data type 

complex 

complex number 

dict 

dictionary 

file 

file 

float 

floating point 

int 

integer 

list 

list 

long 

long integer 

object 

base object (Note: Inherit from object to create a “new” class.) 

str 

string 

tuple 

tuple 

Unicode 

Unicode string (Note: see Appendix F for Information on Unicode.) 


Fig. 9.11 Built-in type names in Python 2.2. 
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display the behaviors of “new” classes. This definition for class SingleList differs from 
our previous definition, because this definition does not maintain as an attribute an internal 
list of values. SingleList is a list, so all methods of the class can treat the object ref- 
erence as a list object—an extra attribute is not necessary. Class SingleList’s con¬ 
structor (lines 7-14) first calls the base-class constructor, to initialize the list. If the client 
passes an initial list value to the class’s constructor, line 14 calls SingleList method 
merge (discussed shortly) to add unique values from the list argument to the empty list ini- 
tialized by the base-class constructor. 




1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 


# Fig 9.12: NewList.py 

# Definition for class SingleList, 

class SingleList( list ) : 

# constructor 

def _init_( self, initialList = None ): 


list._init_( self ) 

if initialList: 

self.merge( initialList ) 

# utility method 

def _raise!fNotUnique( self, value ): 


if value in self: 

raise ValueError, \ 


% value 


# overloaded sequence operation 

def _setitem_( self, subscript, value ): 


# terminate method on non-unique value 

self._raiseIfNotUnique( value ) 

return list._setitem_( self, subscript, value ) 

# overloaded mathematical operators 

def _ add_( self, other ): 


return SingleList( list._add_( self, other ) ) 








Fig. 9.12 Inheriting from built-in type list— class SingleList. (Part 1 of 3.) 
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41 

42 

43 
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45 
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50 

51 

52 
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55 

56 

57 

58 

59 
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62 

63 

64 

65 
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67 
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69 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 
81 
82 

83 

84 

85 

86 

87 

88 

89 

90 

91 

92 

93 


def _ radd_( self, otherList ): 

return SingleList( list._add_( other, self ) ) 

def _ iadd_( self, other ): 

for value in other: 

self.append( value ) 

return self 

def mul_( self, value ): 


raise ValueError, 

# _rmul_ and _ imul_ have same behavior as mul 

_rmul_ = _imul_ = mul_ 


# overridden list methods 

def insert( self, subscript, value ): 


# terminate method on non-unique value 

self._raiseIfNotUnique( value ) 

return list.insert( self, subscript, value ) 
def append( self, value ): 


# terminate method on non-unique value 

self._raiseIfNotUnique( value ) 

return list.append( self, value ) 
def extend( self, other ): 


for value in other: 

self.append( value ) 

# new SingleList method 

def merge( self, other ): 






Fig. 9.12 Inheriting from built-in type list—c Ia ssSingleList. (Part 2 of 3.) 
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94 

# add unique values from 

other 

95 

for value in other: 


96 



97 

if value not in self: 


98 

list.append( self, 

value ) 


Fig. 9.12 Inheriting from built-in type list—classSingleList. (Part3of 3.) 


Lines 17-23 define utility method _raiseIfNotUnique. This method takes as an 
argument a potential value to add to the list and raises an exception if the list already con- 
tains the value. Ali SingleList methods that add new elements to a list first call method 
_raiseIfNotUnique, to ensure that the client inserts only unique values in the list. 
Typically, a client program contains code that detects the exception, to determine whether 
the value was inserted successfully. [Note: We discuss how to detect exceptions in 
Chapter 12, Exception Handling.] 

Method_ setitem _(lines 26-33) executes when a client assigns a value to a par- 

ticular index. The method first calls utility method _raiseIfNotUnique with the value 
to insert. If the value already is in the list, the utility method raises an exception, method 

_setitem _terminates and the value is not added to the list. If the utility method does 

not raise an exception, line 33 calls_ setitem _in the base class, which either assigns 

the value at the specified index or, if the index is out-of-bounds, raises an exception. 





1 

# Fig. 9.13: fig09_13.py 


2 

# Program that uses 

SingleList 


3 




4 

5 

from NewList import 

SingleList 


6 

duplicates = [ , , 

r r r i 

, 1 

7 

print "List with dup 

r 

duplicates 

8 




9 

single = SingleList( 

duplicates ) 

# create SingleList object 

10 

print "SingleList, c 


, single 

11 

print "The length of 


, len( single ) 

12 




13 

# search for values 

in list 


14 

print "\nThe value 2 


% single.count( ) 

15 

print "The value 5 a 


% single.count( ) 

16 

print "The index of 


, single.index( ) 

17 




18 

if in single: 



19 

print value 



20 




21 

# add values to list 



22 

single.append( ) 



23 

single += [ ] 



24 

single.insert( , 

) 


25 

single.extend( [ , 

, 1 ) 


26 

single.merge( [ 

, , 1 

) 

27 

print \nThe list, i 


, single 


Fig. 9.13 Inheriting from built-in type list—fig09_13 .py. 
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28 







29 

# remove values from list 






30 

popValue = single.popO 






31 

print , popValue, 


, single 




32 

single.append( popValue ) 






33 

print , popValue, 


, single 




34 







35 

# slice list 






36 

print "\nThe value of single[ 1:4 ] i 


single[ ] 




List with duplicates is: [1, 2, 2, 3, 4, 

3, 

6, 9] 




SingleList, created from duplicates, is: 

[1, 

2, 3, 4, 6, 9] 




The 

length of the list is: 6 






The 

value 2 appears 1 times in list 






The 

value 5 appears 0 times in list 






The 

index of 9 in the list is: 5 






The 

value 4 was found in list 






The 

list, after adding elements is: [1, 2, 

3, 

'hello', 4, 6, 

9, 

10, 

20, 

-1, 

-2, -3, 100] 






Removed 100 from list: [1, 2, 3, 'hello', 

4, 

6, 9, 10, 20, 

-1, 

-2, 

-3] 

Added 100 back to end of list: [1, 2, 3, 

hello', 4, 6, 9, 10, 

20, 

-1, 

-2, 

-3, 100] 






The 

value of single[ 1:4 ] is: [2, 3, 'hello 

'] 





Fig. 9.13 Inheriting from built-in type list—fig09_13 .py. 


Lines 36-44 overload the + operator for addition when a SingleList appears to the 

left or right of the operator. Methods_ add _and_ radd _each return a new object 

of class SingleList that is initialized with the elements of the two arguments passed to 
either method. This operation has the same effect as merging two lists into one list of 
unique values. Lines 46-53 overload the augmented assignment += Symbol. The method 
performs its operation in-place (i.e., on the object reference itself). For each value in the 

right-hand operand, method _ iadd _calls SingleList method append, which 

either inserts a new value at the end of the list or if the list already contains that value, raises 
an exception. Python expects an overloaded, augmented-assignment method to return an 
object of the class for which the method is defined, so line 53 returns the augmented object 
reference. Lines 55-62 overload the multiplication operation (i.e., list repetition) for 
objects of class SingleList. By definition, a SingleList cannot contain more than 

one occurrence of any value, so method_ mul _raises an exception if the client attempts 

such an operation. Line 62 binds the names for methods_ rmul _(right multiplication) 

and _ imul _ (augmented assignment multiplication) to the method defined for 

_mul _; when clients invoke these operations, the corresponding methods also raise 

exceptions. 

Lines 65-88 define methods insert, append and extend for adding values to a 
list. Methods insert and append first invoke utility method 
_raise!fNotUnique —to prevent the client from adding duplicate values to the list— 
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before invoking the base-class version of the corresponding method. Method extend uses 
method append to add elements from another list to the reference object. 

Method merge (lines 91-98) provides clients the ability to merge a SingleList 
with another list that possibly contains duplicate values. Method merge provides the same 
behavior that base-class list provides with method extend. However, method extend 
in the derived class raises an exception if the client attempts to extend the SingleList 
with a list that would insert duplicate values in the SingleList. By providing method 
merge, we give clients a way to extend a SingleList without raising an exception. The 
method adds only unique values to the SingleList, by calling list. append for 
every unique value in the client-supplied list. 

The driver program of Fig. 9.13 uses both SingleList-specific functionality and 
functionality inherited from base-class list. Lines 6-7 create and print list dupli- 
cates, which contains duplicate values. Line 9 creates an object of class SingleList, 
which passes duplicates to the constructor. The new object— single —of class 
SingleList contains one of each of the values from list duplicates. The remainder 
of the driver program demonstrates SingleList’s capabilities. Line 10 prints single, 

which implicitly invokes the object’s base-class _ str _ method. Line 11 passes 

single to function len, which calls the object’s base-class_ len _method to deter- 

mine the number of elements in the list. 

Lines 14-16 call single’s methods count and index to determine whether cer- 
tain elements exist in the list and to locate an element in the list, respectively. Line 18 uses 
keyword in, which implicitly invokes the base-class_ contains _method, to deter¬ 

mine whether the list contains the integer element 4. Lines 22-25 call overridden Sin¬ 
gleList methods to add elements to the list. Line 22 calls method append to add an 
element to the list. Line 23 appends an element with Symbol +=, which implicitly invokes 

the object’s_ iadd _method. Line 24 calls method insert to insert the element 

"hello" at index 3. Line 25 calls method extend to add elements from another list to 
single. Ali these methods add unique elements to the list; if one of the method calls 
attempted to add a duplicate value to the list, the method would raise an exception (as 
shown in Fig. 9.14). The call to method merge in line 26 merges the values in single 
with values from another list. Notice, from the output, that the effect of call in line 26 is 
to add only the integer element 100, because this element is the only value that single 
did not yet contain. 

Lines 30-33 of Fig. 9.13 remove an element from the list, add the element back in to 
the list and print the results. These statements demonstrate that the client can remove a 
value from the list, using base-class method pop, and that reinserting the removed value 
does not raise an exception. Line 36 demonstrates that class SingleList inherits slicing 
capabilities from base-class list. This underscores the benefit of inheritance-based Soft¬ 
ware reuse. In the previous definition of class SingleList, we would have had to pro¬ 
gram this capability explicitly. In this version, we simply inherit the capability from the 
base class. 

9.12.3 get attribute_Method 

In Chapter 8, Customizing Classes, we discussed method_ getattr _, which executes 

when a client attempts to access an object attribute and that attribute name is not in the ob- 
ject’s_ dict _, the_ dict _of the object’s class or the_ dict _of the class’s di- 
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Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on win32 
Type "help", "Copyright", "credits" or "license" for more information. 
>» 

>» from NewList import SingleList 
>» single = SingleList ( [1, 2, 3 ] ) 

>» 

>» single. append ( 1 ) 

Traceback (most recent call last): 

File "<stdin>", line 1, in ? 

File "NewList.py", line 79, in append 
self._raiseIfNotUnique( value ) 

File "NewList.py", line 22, in _raiseIfNotUnique 
raise ValueError, \ 

ValueError: List already contains value 1 

>» 

>» single += [ 2 ] 

Traceback (most recent call last): 

File "<stdin>", line 1, in ? 

File "NewList.py", line 51, in _iadd_ 

self.append( value ) 

File "NewList.py", line 79, in append 
self,_raiseIfNotUnique( value ) 

File "NewList.py", line 22, in _raiseIfNotUnique 
raise ValueError, \ 

ValueError: List already contains value 2 

>» 

>» single. insert ( 0, 1 ) 

Traceback (most recent call last): 

File "<stdin>", line 1, in ? 

File "NewList.py", line 70, in insert 
self,_raiseIfNotUnique( value ) 

File "NewList.py", line 22, in _raiseIfNotUnique 
raise ValueError, \ 

ValueError: List already contains value 1 
>» 

>» single.extend( [3, 4 ] ) 

Traceback (most recent call last): 

File "<stdin>", line 1, in ? 

File "NewList.py", line 88, in extend 
self.append( value ) 

File "NewList.py", line 79, in append 
self._raiseIfNotUnique( value ) 

File "NewList.py", line 22, in _raiseIfNotUnique 
raise ValueError, \ 

ValueError: List already contains value 3 


Fig. 9.14 C Iass SingleList— inserting non-unique values. 

rect and indirect base classes. Classes that inherit from base-class ob ject also can define 
method_ getattribute _, which executes for every attribute access. Figure 9.15 con¬ 

tains a simple example. We define class DemostrateAccess (lines 4-29), which inherits 

from base-class ob ject and provides both_ getattr _and_ getattribute_ 

methods. The constructor creates one attribute— value —and initializes it to 1. 
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Method_ getattribute _(lines 13-19) executes every time the client attempts 

to access an object’s attribute through the dot (.) access operator. The method prints a line 
indicating that the method is executing and a line that displays the name of the attribute that 
the client is attempting to access. Line 19 retums the resuit of calling base-class method 

_getattribute _, passing the specified attribute name. Method 

_getattribute _in a derived class must call the base-class version of the method to 

retrieve an attribute’s value, because attempting to access the attribute’s value through the 
object’s_ dict _would resuit in another call to_ getattribute_. 


Common Programming Error 9.5 



To ensure proper attribute access, a derived-class version of method 

_ getattribute _ should call the base-class version ofthe method. Attempting to re- 

turn the attribute’s value by accessing the object’s _ dict _ causes infinite recursion. 


Lines 21-29 define method_ getattr _, which performs the same behavior as in 

“classic” classes; namely, the method executes when the client attempts to access an 

attribute that the object’s_ dict _does not contain. The method displays output that 

indicates the method is executing and provides the name of the attribute that the client 
attempted to access (lines 24—26). Lines 28-29 raise an exception to preserve Python’s 
default behavior of raising an exception when a client accesses a nonexistent attribute. 
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22 
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27 
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# Fig. 9.15: fig09_15.py 

# Class that defines method getattribute 

class DemonstrateAccess( object ): 


def _ init_( self ): 


self.value = 

def _ getattribute_( self, name ): 

print _ getattribute _ 

print , name 

return object._getattribute_( self, name ) 

def _getattr_( self, name ): 


print _getattr_ executing.. 

print , \ 

name 

raise AttributeError, \ 

% name 








Fig.9.15 _getattribute _method and attribute access. (Part 1 of 2). 
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Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on win32 
Type "help", "Copyright", "credits" or "license" for more information. 
>» 

>» from fig09_15 import DemonstrateAccess 
>» access = DemonstrateAccess () 

>» 

>» access.value 
_getattribute executing... 

Client attempt to access attribute: value 

1 

>» 

>» access. novalue 
_getattribute executing... 

Client attempt to access attribute: novalue 
_getattr_ executing... 

Client attempt to access non-existent attribute: novalue 
Traceback (most recent call last): 

File "<stdin>", line 1, in ? 

File "fig09_15.py", line 28, in _getattr_ 

raise AttributeError, "Object has no attribute %s" \ 
AttributeError: Object has no attribute novalue 

Fig.9.15 _getattribute_method and attribute access. (Part 1 of 2). 

The interactive session in the output box for Fig. 9.15 demonstrates when methods 

_ getattribute _and_ getattr _execute. We first create an object of class 

DemonstrateAccess, then access attribute value, using the dot access operator. The 

output indicates that method_ getattribute _executes in response to the attribute 

access; Python displays the return value (1) in the interactive session. Next, the program 
accesses attribute novalue, a nonexistent attribute. Method_ getattribute _exe¬ 

cutes first, because the method executes every time the client attempts to access an 
attribute. When the base-class version of the method determines that the object does not 

contain a novalue attribute, method_ getattr _executes. The method raises an 

exception to indicate that the client has accessed a nonexistent attribute. 

9.12.4 _slots_Class Attribute 

Python’s dynamism enables programmers to write applications that can change as they ex¬ 
ecute. Often, this is useful for Software development purposes. For example, during the de- 
velopment cycle, a graphical-application programmer might create Software that enables 
the programmer to change the application’s appearance (i.e., some of the application’s 
code) without terminating the application. This technique also is valuable for applications 
like Web servers that must continue executing for long periods of time, but that may need 
to change periodically to incorporate new features. Dynamism also has drawbacks—usual- 
ly dynamic applications or applications programmed in a dynamic language exhibit poorer 
performance than do their non-dynamic counterparts. 

One side-effect of Python’s dynamic nature is that a program can add attributes to an 
object’s namespace after the object has been created. This practice sometimes can lead to 
unexpected results. For example, the programmer could incorrectly type an attribute name 
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in an assignment statement. Rather than printing an eri'or, such an assignment statement 
simply binds a new attribute name and value to the object, and the program continues exe- 

cuting. Python 2.2 allows new classes to define a_ slots _attribute listing the only 

attributes that objects of the class are allowed to have. Figure 9.16 presents two simplified 
definitions of a point—classes PointWithoutSlots and PointWithSlots. A pro¬ 
gram can add attributes to objects of class PointWithoutSlots, but cannot add 
attributes to objects of class PointWithSlots. 
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# Fig. 9.16: Slots.py 

# Simple class with slots 

class PointWithoutSlots: 


def _ init _( self, xValue = , yValue = ): 


self.x = float ( xValue ) 
self.y = float( yValue ) 

class PointWithSlots( object ): 

" 

_slots_ = [ , ] 

def _init_( self, xValue = , yValue = ): 

"""Constructor for PointWithoutSlots, initializes x- and 


self.x = float( xValue ) 
self.y = float( yValue ) 

# main program 

def main(): 

noSlots = PointWithoutSlots() 
slots = PointWithSlots() 

for point in [ noSlots, slots ]: 

print "\nProcessing an object of cla 

print "The current value of point.x 

newValue = float( raw_input( 

print "Attempting to set new x-coord. 


point._class_ 

point.x 

) ) 


# Logic error: create new attribute called X, instead of 

# changing the value of attribute X 

point.X = newValue 


# output unchanged attribute x 

print , point.x 






Fig. 9.16 _slots _attribute—specifying object attributes 
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45 

46 if _name 

47 main() 


Processing an object of class _main_.PointWithoutSlots 

The current value of point.x is: 0.0 
Enter new x coordinate: 1.0 

Attempting to set new x-coordinate value... 

The new value of point.x is: 0.0 

Processing an object of class <class '_main_.PointWithSlots'> 

The current value of point.x is: 0.0 
Enter new x coordinate: 1.0 

Attempting to set new x-coordinate value... 

Traceback (most recent call last): 

File "Slots.py", line 47, in ? 
main () 

File "Slots.py", line 41, in main 
point.X = newValue 

AttributeError: 'PointWithSlots' object has no attribute 'X' 


Fig. 9.16 _slots_attribute—specifying object attributes. 


The PointWithoutSlots definition (lines 4-12) simply detines a constructor 
(lines 7-12) that initializes the point’s x- and y-coordinates. Class PointWithSlots 

(lines 14-25) inherits from base-class object, and detines an attribute_ slots —a 

list of attribute names that objects of the class may contain. When a new class detines the 

_slots _attribute, objects of the class can assign values only to attributes whose 

names appear in the_ slots _list. If a client attempts to assign a value to an attribute 

whose name does not appear in_ slots _, Python raises an exception. 



If a new class defines attribute _ slots _, but the class’s constructor does not initialize 

the attributes’ values, Python assigns None to each attribute in _ slots _ when an object 

ofthe class is created. 



A derived class inherits its base-class _ slots _ attribute. However, if programs should 

not be allowed to add attributes to objects ofthe derived class, the derived class must define 

its own _ slots _ attribute. The derived-class _ slots _ contains only the allowed 

derived-class attribute names, but clients stili can set values for attributes specifled by the 
derived class’s direct and indirect bases classes. 


The driver program (lines 28-44) demonstrates the difference between an object of a 

class that defines_ slots _and an object of a class that does not define_ slots_. 

Lines 29-30 assign create objects of classes PointWithoutSlots and PointsWith- 
Slots, respectively. The for loop in lines 32-44 iterates over each object and attempts 
to replace the value of the object’s x attribute with a user-supplied value, obtained in line 
36. Line 41 contains a logic error—the program intends to modify the value of the object’s 
x attribute, but mistakenly creates an attribute called X and assigns the user-entered value 
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to the new attribute. For objects of class PointWithoutSlots (e.g., object noSlots), 
line 41 executes without raising an exception, and line 44 prints the unchanged value of 
attribute x. For objects of class PointWithSlots (e.g., slots), line 41 raises an excep¬ 
tion, because the object’s_ slots _attribute does not contain the name "X". 

The example inFig. 9.16 demonstrates one benefit of defining the slots _attribute 

for new classes, namely preventing accidental attribute creation. Programs that use new 
classes also gain performance benefits, because Python knows in advance that programs 
cannot add new attributes to an object; therefore, Python can store and manipulate the objects 

in a more efficient manner. A disadvantage of_ slots _is that experienced Python pro- 

grammers sometimes expect the ability to add object attributes dynamically. Defining 
_slots _can inhibitprogrammers’ abilities to create dynamic applications quickly. 

9.12.5 ftoperties 

Python’s new classes can contain properlies that describe object attributes. A program ac- 
cesses an object’s properties using object-attribute syntax. However, a class definition cre- 
ates a property by specifying up to four components—a get method that executes when a 
program accesses the property’s value, a set method that executes when a program sets the 
property’s value, a delete method that executes when a program deletes the value (e.g., with 
keyword dei) and a docstring that describes the property. The get , set and delete methods 
can perform the tasks that maintain an object’s data in a consistent state. Thus, properties 
provide an additional way for programmers to control access to an object’s data. 

Figure 9.17 redefines class Time —the class previously used to demonstrate attribute 
access—to contain attributes hour, minute and second as properties. The constructor 

(lines 7-12) creates private attributes _hour,_minute and _second. Typically, 

classes that use properties define their attributes to be private, to hide the data from clients 
of the class. The clients of the class then access the public properties of that class, which 
get and set the values of the private attributes. 

Method deleteValue (lines 20-23) raises an exception to prevent a client from 
deleting an attribute. We use this method to create properties that the client cannot delete. 
Each property (hour, minute and second) defines corresponding get and set methods. 
Each get method takes only the object reference as an argument and returns the property’s 
value. Each set method takes two arguments—the object-reference argument and the new 
value for the property. Lines 25-32 define the set method (setHour) for the hour prop¬ 
erty. If the new value is within the appropriate range, the method assigns the new value to 
the property; otherwise, the method raises an exception. Method getHour (lines 34-37) 
is the hour property’s get method, which simply returns the value of the corresponding 
private attribute ( _hour). 


1 # Fig. 9.17: TimeProperty.py 

2 # Class Time with properties 

3 

4 class Time( object ): 

5 

6 


Fig. 9.17 Properties—c Ia s Time. (Part 1 of 3). 

































pythonhtpl_09.fm Page 334 Friday, December 14, 2001 2:01 PM 





334 Object-Oriented Programming: Inheritance 


Chapter 9 




7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 


def _init_( self, hourValue, minuteValue, secondValue ): 


self._hour = hourValue 

self._minute = minuteValue 

self._second = secondValue 

def _ str_( self ): 


return % \ 

( self._hour, self._minute, self._second ) 

def deleteValue( self ): 


raise TypeError, 
def setHour ( self, value ): 


if <= value < : 

self._hour = value 

else : 

raise ValueError, \ 


value 


(«) 


def getHour( self ): 


return self._hour 

# create hour property 

hour = property( getHour, setHour, deleteValue, ) 

def setMinute( self, value ): 


if <= value < : 

self._minute = value 

else : 

raise ValueError, \ 

% value 


def getMinute( self ): 


return self._minute 

# create minute property 

minute = property( getMinute, setMinute, deleteValue, ) 








Fig. 9.17 Properties— classTime. (Part 1 of 3). 
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59 def setSecond( self, value ): 

60 """Set method for second attribute""" 

61 

62 if <= value < : 

63 self. second = value 

64 else : 

65 raise ValueError, \ 

66 % value 

67 

68 def getSecond( self ) : 

69 Get method for second attribute""" 

70 

71 return self._second 

72 

73 # create second property 

74 second = property( getSecond, setSecond, deleteValue, ) 


Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on win32 
Type "help", "Copyright", "credits" or "license" for more information. 
>» 

>» from TimeProperty import Time 
>» 

>» timel = Time ( 5, 27, 19 ) 

>» print timel 
05:27:19 

>» print timel.hour, timel.minute, timel.second 
5 27 19 
>» 

>» timel.hour, timel.minute, timel.second = 16, 1, 59 
>» print timel 
16:01:59 
>» 

>» timel.hour = 25 

Traceback (most recent call last): 

File "<stdin>", line 1, in ? 

File "TimeProperty.py", line 31, in setHour 
raise ValueError, \ 

ValueError: hour (25) must be in range 0-23, inclusive 
>» 

>» timel.minute = -3 

Traceback (most recent call last): 

File "<stdin>", line 1, in ? 

File "TimeProperty.py", line 48, in setMinute 
raise ValueError, \ 

ValueError: minute (-3) must be in range 0-59, inclusive 

>» 

>» timel. second = 99 

Traceback (most recent call last): 

File "<stdin>", line 1, in ? 

File "TimeProperty.py", line 65, in setSecond 
raise ValueError, \ 

ValueError: second (99) must be in range 0-59, inclusive 






Fig. 9.17 Properties— classTime. (Part 1 of 3). 
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Built-in function property (line 40) takes as arguments a get method, a set method, 
a delete method and a docstring and returns a property for the class. Line 40 creates the 
hour property by passing to function property methods getHour, setHour and 
deleteValue and the string "hour" . Clients access properties, using the dot (.) access 
operator. When the client uses a property as an rvalue, the property’s get method executes. 
When the client uses the property as an Ivalue, the property’s set method executes. When 
the client deletes the property with keyword dei, the property’s delete method executes. 
The remainder of the class definition (lines 42-74) defines get and set methods for proper¬ 
ties minute (created in line 57) and second (created in line 74). 



Function property does not require that the caller pass allfour arguments. Instead, the 
caller can pass valuesfor keyword arguments fget. fset, fdel and doc to specify the 
property ’s get, set and delete methods and the docstring, repsectively. 


The interactive session in Fig. 9.17 highlights the benefits of properties. A client of the 
class can access an object’ s attributes, using the dot access operator, but the class author 
also can ensure data integrity. Properties have added advantages over implementing 

methods _ setattr_, _getattr _ and _ delattr _. For example, class 

authors can state explicitly the attributes for which the client may use the dot access nota- 
tion. Additionally, the class author can write separate get, set and delete methods for each 
attribute, rather than using if/else logic to determine which attribute to access. 

In this chapter, we discussed the mechanics of inheritance and how inheritance pro- 
motes Software reuse and data abstraction. We discussed two examples of inheritance—one 
example of structural inheritance and one example of a class hierarchy headed by an 
abstract base class. We also introduced new object-oriented-programming features avail- 
able in Python 2.2. We continued our discussion of data integrity by presenting proper¬ 
ties—a feature that allows clients of the class to access data with the dot access operator 
and allows classes to maintain private data in a consistent state. Data hiding and data integ¬ 
rity are fundamental object-oriented Software design principies. The topics discussed in this 
and the previous two chapters provide a solid foundation for programmers who want to 
build large, industrial-strength Software systems in Python. 


SUMMARY 

• Inheritance is a forrn of Software reusability in which new classes are created from existing classes 
by absorbing their attributes and behaviors and then overriding or embellishing these with capa- 
bilities the new classes require. 

• When creating a new class, instead of writing completely new attributes and methods, the pro- 
grammer can designate that the new class is to inherit the attributes and methods of a previously 
defined base class. 

• The class that inherits from a base class is referred to as a derived class. Each derived class itself 
becomes a candidate to be a base class for some future derived class. 

• With single inheritance, a class is derived from one base class. 

• With multiple inheritance, a derived class inherits from multiple (possibly unrelated) base classes. 
Multiple inheritance can be complex and error prone. 

• The real strength of inheritance comes from the ability to define in the derived class additions, re- 
placements or refinements for the features inherited from the base class. 
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With inheritance, every object of a derived class also may be treated as an object of that derived 
class’s base class. However, the converse is not true—base-class objects are not objects of that 
base class’s derived classes. 

With polymorphism, it is possible to design and implement systems that are more easily extensi- 
ble. Programs can be written to process generically—as base-class objects—objects of all existing 
classes in a hierarchy. 

Polymorphism enables us to write programs in a general fashion to handle a wide variety of exist¬ 
ing and yet-to-be-specified related classes. 

Object-Oriented programming provides several ways of “seeing the forest through the trees”—a 
process called abstraction. 

“Is a” is inheritance. In an “is-a” relationship, an object of a derived-class type may also be treated 
as an object of the base-class type. 

“Has a” is composition. In a “has-a” relationship, an object has references to one or more objects 
of other classes as members. 

A derived class can access the attributes and methods of its base class. When a base-class member 
implementation is inappropriate for a derived class, that member can be overridden (i.e., replaced) 
in the derived class with an appropriate implementation. 

Inheritance forms tree-like hierarchical structures. A base class exists in a hierarchical relationship 
with its derived classes. 


Function issubclass takes two arguments that are classes and returns true if the first argument 
is a class that inherits from the second argument (or if the first argument is the same class as the 
second argument) 


Python provides a built-in function— isinstance —that determines whether an object is an ob¬ 
ject of a given class or of a subclass of that class. 


Parentheses, (), in the first line of the class definition indicates inheritance. The narne of the base 
class (or base classes) is placed inside the parentheses. 


A direct base class of a derived class is explicitly listed inside parentheses when the derived class 
is defined. 


An indirect base class is not explicitly listed when the derived class is defined; rather the indirect 
base class is inherited from two or more levels up the class hierarchy. 

To initialize an object of a derived class, the derived-class constructor must call the base-class con¬ 
structor. 


A bound method call is invoked by accessing the method name through an object. Python auto- 
matically inserts the object reference argument for bound method calls. 

An unbound method call is invoked by accessing the method through its class name then specifi- 
cally passing an object. 

Aclass’s_ bases _attribute is a tuple that contains references toeach of the class’s base classes. 

A derived class can override a base-class method by supplying a new version of that method with 
the same name. When that method is mentioned by name in the derived class, the derived-class 
version is automatically selected. 

A base class specifies commonality. In the object-oriented design process, the designer looks for 
commonality and “factors it out” to form base classes. Derived classes are then customized beyond 
the capabilities inherited from the base class. 

A program uses an object if the program simply calls a method of that object through a reference. 
An object is said to have a knows a relationship with a second object if the first object is aware of 
(i.e., has a reference to) the second object. This is sometimes called an association. 
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• There are cases in which it is useful to define classes for which the programmer never intends to 
create any objects. Such classes are called abstract classes. 

• The sole purpose of an abstract class is to provide an appropriate base class from which classes 
may inherit interface and possibly implementation. Classes from which objects can be created are 
called concrete classes. 

• Python does not provide a way to designate an abstract class. However, the programmer can im- 

plement an abstract class by raising an exception in the class’s_ init _method. 

• Python is inherently polymorphic because the language is dynamically typed. This means that Py¬ 
thon determines at runtime whether an object defines a method or contains an attribute and, if so, 
calls the appropriate method or accesses the appropriate attribute. 

• Using polymoiphism, one method call can cause different actions to occur depending on the class 
of the object receiving the call. This gives the programmer tremendous expressive capability. 

• Beginning with Python 2.2, the nature and behavior of classes will change. In all future 2.x releas- 
es, a programmer can distinguish between two kinds of classes: “classic” classes and “new” class¬ 
es. In Python 3.0, all classes will behave like “new” classes. 

• Python 2.2 provides type object for defining “new” classes. Any class that inherits from ob¬ 
ject exhibits the new-class behaviors. 

• “New” classes can define static methods. A static method can be called by a client of the class, 
even if no objects of the class exist. 

• A class designates a method as static by passing the method’s name to built-in function static- 
method and binding a name to the value returned from the function call. 

• Static methods differ from regular methods in that when a program calls a static method, Python 
does not pass the object reference argument to the method. Therefore, a static method does not 
specify self as the first argument. 

• The goal of the new class behavior is to remove the dichotomy that existed between Python types 
and classes before version 2.2. The most practical use of this type-class unification is that program- 
mers now can inherit from Python’s built-in types. 

• Classes that inherit from base-class object also can define method_ getattribute_, 

which executes for every attribute access. 

• Method_ getattribute _in a derived class must call the base-class version of the method 

to retrieve an object’s attribute; otherwise, infinite recursion occurs. 

• Python 2.2 allows “new” classes to define a_ slots _attribute listing the attributes that ob¬ 

jects of the class are allowed to have. 

• When a “new” class defines the_ slots _attribute, objects of the class can assign values only 

to attributes whose names appear in the_ slots _list. If a client attempts to assign a value to 

an attribute whose name does not appear in_ slots _, Python raises an exception. 

• ““New” classes can contain properties that describe object attributes. A program accesses an ob¬ 
ject’s properties in the same manner as accessing the object’s attributes. 

• A class definition creates a property by specifying four components—a get method, a set method, 
a delete method and a docstring that describes the property. The get, set and delete methods can 
perform any tasks necessary for maintaining data in a consistent state. 

• Classes that use properties most often define their attributes to be private, to hide the data from 
clients of the class. The clients of the class then access the public properties of that class, which 
get and set the values of the private attributes. 

• Built-in function property takes as arguments a get method, a set method, a delete method and 
a docstring and retums a property for the class. 
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TERMINOLOGY 

_bases _attribute of a class 

_getattribute _method 

_slots _attribute of a class 

“has-a” relationship 

“is-a” relationship 

“knows-a” relationship 

“uses-a” relationship 

abstract class 

abstract method 

abstraction 

association 

base class 

bound method call 

class library 

complex type 

composition 

concrete class 

derived class 

dict type 

direct base class 

extensible 

file type 

float type 

indirect base class 

inherit 

inheritance 


int type 

isinstance function 

issubclass function 

list type 

long type 

multiple inheritance 

NotlmplementedError exception 

ob ject base class 

object type 

overriding a method 

polymorphism 

property 

property function 
reusability 
single inheritance 
standardized reusable components 
static method 

staticmethod function 
str type 

structural inheritance 
subclass 
superclass 
tuple type 
unbound method call 
Unicode type 


SELF-REVIEW EXERCISES 

9.1 Fili in the blanks in each of the following: 

a) With_, a class is derived from several base classes. 

b) In other object-oriented programming languages, like Java, the base class is called the 

_and the derived class is the_. 

c) A has-a relationship creates new classes by_of existing classes. 

d) When an object has a knows a relationship with another object, this is an_. 

e) A base class exists in a_relationship with its derived classes. 

f) _in the first line of a class definition are used to indicate inheritance. 

g) An_is inherited from two or more levels up the class hierarchy. 

h) A base class specifies_—ali classes derived from a base class inherit the ca- 

pabilities of that base class. 

i) _are classes for which the programmer never intends to create objects. 

j) A_method does not require an object of the class to perform its operation. 

9.2 State whether each of the following is true or false. If false, explain why. 

a) The derived class inherits ali the attributes and methods of its base class. 

b) A derived class must define a constructor that calls the base class’s constructor. 

c) Ali base classes of a derived class are explicitly listed inside parentheses when the de¬ 
rived class is defined. 

d) To use an object of another class, a class must inherit from that class. 
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e) A derived class uses only the base-class methods that it overrides. 

f) A derived class’s constructor can invoke the base class’s constructor through an unbound 
method call. 

g) The name of the base class can be used to access the base class version of an overridden 
method from the derived class. 

h) Placing a comma-separated list of base classes inside parentheses in a class definition in- 
dicates multiple inheritance. 

i) Polymorphism enables multiple inheritance. 

j) Python does not implement polymorphism. 

ANSWERS TO SELF-REVIEW EXERCISES 

9.1 a) multiple inheritance. b) superclass, subclass. c) composition. d) association. 
e) hierarchical. f) Parentheses, g) indirect base class. h) commonality. i) Abstract classes, j) static. 

9.2 a) True. b) False. If a derived class does not define a constructor, Python calls the base class’s 
constructor, c) False. Only the direct base classes of a derived class are explicitly listed. d) False. A 
program uses an object of another class by importing the class and creating the object or using com¬ 
position to define a class that contains a reference to an object of that class. e) False. A derived class 
has access to all of its base class’s methods. f) True. g) True. h) True. i) False. Polymorphism is the 
ability for objects of different classes related by inheritance to respond differently to the same mes- 
sage. j) False. Python is inherently polymorphic because it is dynamically typed. 

EXERCISES 

9.3 Study the inheritance hierarchy of Fig. 9.2. For each class, indicate some common attributes 
and behaviors consistent with the hierarchy. Add some other classes (e.g., UndergraduateStu- 
dent, GraduateStudent, Freshman, Sophomore, Junior. Senior, etc.) to enrich the hi¬ 
erarchy. 

9.4 Consider the class Bicycle. Given your knowledge of some common components of bicy- 
cles, show a class hierarchy in which the class Bicycle inherits from other classes, which, in tum, 
inherit from yet other classes. Discuss the creation of various objects of class Bicycle. Discuss in¬ 
heritance from class Bicycle for other closely related derived classes. 

9.5 Many programs written with inheritance could be solved with composition instead, and vice 
versa. Discuss the relative merits of these approaches in the context of the Point, Circle, Cyl- 
inder class hierarchy in this chapter. Rewrite the classes in Figs. 8.6-8.8 (and the supporting pro¬ 
grams) to use composition rather than inheritance. After you do this, reassess the relative merits of 
the two approaches both for the Point, Circle, Cylinder problem and for object-oriented pro¬ 
grams in general. 

9.6 Write an inheritance hierarchy for class Quadrilateral, Trapezoid, Parallelo- 
gram, Rectangle and Square. Use Quadrilateral as the base class of the hierarchy. Make 
the hierarchy as deep (i.e., as many levels) as possible. The data of Quadrilateral should be the 
(x, y) coordinate pairs for the four endpoints of the Quadrilateral. Write a driver program that 
creates and displays objects of each of these classes. 

9.7 Write a function that prints a class hierarchy. The function should take one argument that is 
an object of a class. The function should determine the class of that object and all direct and indirect 
base classes of the object. [Note: For simplicity, assume each class in the hierarchy uses only single 
inheritance.] The function prints each class name on a separate line. The first line contains the top- 
most class in the hierarchy, and each level in the hierarchy is indented by three spaces. For example, 
the output for the function, when passed an object of class Cylinder from Fig. 9.8, should be: 
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Point 

Circle 

Cylinder 


9.8 Create a class Date that has data members for the day, the month and the year. Modify the 
payroll system of Fig. 9.9 to add data members birthDate (an object of class Date) and 
departmentCode (a number) to class Employee. Assume this payroll is processed once per 
month. Then, as your program calculates the payroll for each Employee, add a $100.00 bonus to the 
person’s payroll amount if this is the month in which the Employee 's birthday occurs. 
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E) 




Graphical U ser Interface 
Components: Part 1 




Objectives 

• To understand the design principies of graphical user 
interfaces. 

• To use the Tkinter module to build graphical user 
interfaces. 

• To create and manipulate labeis, text fields, buttons, 
check boxes and radio buttons. 

• To leam to use mouse events and keyboard events. 

• To understand and use layout managers. 

... the wisestprophets make sure ofthe eventfirst. 

Horaee Walpole 

Do you think I can listen ali day to such stujf? 

Lewis Carroll 

Speak the affirmative; emphasize your choice by utter 
ignoring of ali tliat you reject. 

Ralph Waldo Emerson 

You pays your money and you takes your choice. 

Punch 

Guess ifyou can, choose ifyou dare. 

Pierre Corneille 

All hope abandon, ye who enter here! 

Dante Alighieri 
Exit, pursued by a bear. 

William Shakespeare 
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10.6 

Button Component 

10.7 

Checkbutton and Radiobutton Components 

10.8 
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10.9 

Keyboaid EventHandling 

10.10 

LayoutManageis 


10.10.1 Pack 


10.10.2 Grid 


10.10.3 Place 

10.11 

Card Shuffling and Dealing Smulation 

10.12 

Internet and World Wde Web Resources 

Summary • Terminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 



10.1 Introduc tion 


A graphical user interface {GUI) allows a user to interact with a program. A GUI (pro- 
nounced “GOO-eE”) gives a program a distinctive “look” and “feel.” Providing different 
programs with a consistent set of intuitive interface components provides users with a basic 
level of familiarity with GUI programs before they ever use them. In turn, this reduces the 
time users require to learn programs and increases their ability to use the programs in a pro¬ 
ductive manner. 



Look-and-Feel Observation 10.1 


Consistent user inteifaces enable users to learn new applications jaster. 


GUIs are built from GUI components (called widgets —shorthand for window gad- 
gets). A GUI component is an object with which a user interacts via a mouse or a keyboard. 
Figure 10.1 contains an example of a GUI, an Internet Explorer window with some of its 
GUI components labeled. There is a menu bar containing such menus as File, Edit and 
View. Below the menu bar is a set of buttons (e.g., Back. Search, and History), each of 
which has a defined task in Internet Explorer. Below the buttons is a textfield in which a 
user can type a Web site address. To the left of the text field is a label (i.e., Address) that 
indicates the purpose of the text field. The menus, buttons, text fields and labeis are part of 
the Internet Explorer GUI. These components enable a user to interact with the Internet 
Explorer program by just pointing with a mouse and clicking an element. 



































pythonhtpl_10.fm Page 344 Friday, December 14, 2001 2:02 PM 






344 Graphical User Interface Components: Part 1 


Chapter 10 



Label 


Menu bar 


Textfield 


Butto n 


Menu 


Fig. 10.1 GUI components in an Internet Explorerwindow. 




Python programmers can construet GUIs by using the Tool Command Lcmguage 
(TCL) program and its graphic interface development tool, Tool Kit (Tk). (Information 
about this scripting language and its components can be found at www.scrip- 
tics . com.) Figure 10.2 lists several common GUI components found in Tk. This chapter 
and the next discuss these and other GUI components in detail. 


Component 

Deseri ption 

Frame 

Serves as a Container for other components. 

Label 

Displays uneditable text or icons. 

Entry 

Accepts user input from the keyboard, or displays informadon. A sin- 
gle-line input area. 

Text 

Accepts user input from the keyboard, or displays informadon. A 
multiple-line input area. 

Button 

Triggers an event when clicked. 

Checkbutton 

Selection component that is either chosen or not chosen. 

Radiobutton 

Selection component that allows the user to choose only one option. 

Menu 

Displays a list of items from which the user can select. 

Canvas 

Displays text, images, lines or shapes. 

Scale 

Allows the user to select from a range of integers using a slider. 

Listbox 

Displays a list of text options. 

Menubutton 

Displays popup or pull-down menu. 

Scrollbar 

Displays a scrollbar for canvases, text fields and lists. 








Fig. 10.2 GUI components 
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10.2 Tkinter OverView 

The Tkinter module often is used to program GUIs in Python because it is Python’s Stan¬ 
dard GUI package—it comes packaged with the Python program. 1 (Other GUI packages 
also are available for use with Python, but for this text, we use Tkinter). The Tkinter 
library provides an objected-oriented interface to the Tk GUI toolkit. As an object-oriented 
layer on top of Tk/TCL, each Tk GUI component in the Tkinter module is a class that 
inherits from class Widget (Fig. 10.3). All Widget-derived classes have common at- 
tributes and behaviors. 

A GUI consists of a top-level (or, parent) component that can contain other GUI com¬ 
ponents. The components that are contained in the parent are children of the top-level com¬ 
ponent, and each child may contain other children. The concept of parent-child components 







Fig. 10.3 Widget subclasses. 


1. The Tkinter module is portable across many platforms. Some platforms, however, 
need to have Tcl/Tk and Tkinter installed. The Deitel & Associates, Inc. Web site, 
www. deitel. com, contains installation instructions for various platforms. 
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should not be confused with the relationship between a base class and a derived class. A 
program builds a GUI from the top-level component by creating new components and 
placing each new component in the parent component. 

Each program in this chapter implements a GUI by inheriting from Widget’s subclass 
Frame. In our programs, Frame will serve as the top-level component to which children 
are added to extend the GUI’s functionality. This inheritance enables the reuse of compo¬ 
nents in other GUI programs and promotes object-orientation. 

| -p, Portability Tip 10.1 

m The Tkinter module can design graphical user interfaces for Unix, Macintosh and Win- 
dows platforms. 

10.3 Smple Tkinter Example: Label Component 

Labeis display text or images that provide instructions or other information in graphical 
user interfaces. Figure 10.4 demonstrates class Label —the Tkinter class that repre- 
sents a label component. 
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11 

12 

13 

14 

15 

16 

17 

18 

19 
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22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 


# Fig. 10.4: figl0_04.py 

# Label demonstration. 


from Tkinter import * 
class LabelDemo( Frame ): 


def _ init_( self ): 

"""Create three Labeis and pack them""" 

Frame._init_( self ) # initializes Frame object 

# frame filis all available space 

self.pack( expand = , fili = ) 

self.master.title( ) 

self.Labell = Label( self, text = ) 

# resize frame to accommodate Label 

self.Labell.pack() 

self.Label2 = Label( self, 

text = ) 

# insert Label against left side of frame 

self.Label2.pack( side = ) 

# using default bitmap image as label 

self.Label3 = Label( self, bitmap = ) 

self.Label3.pack( side = ) 








Fig. 10.4 Labeis demonstration. (Part 1 of 2.) 
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33 def main(): 

34 LabelDemo() .mainloopO 

35 

36 if _ name_ == 

37 main() 

^iejxj 

Label with lext 

Labeis wilh texi and a bitmap | 


Labeis 



Fig. 10.4 Labeis demonstration. (Part2of 2.) 

Line 4 imports Tkinter class definitions and predefined values, or constants. In 
Chapter 4, Functions, we discussed how to import all elements from a module 

from module import * 

This statement allows us to write less code because specific definitions do not need to be 
accessed through the module’s name. However, importing all definitions can cause errors. 
For example, if we import * from a module that defines a function len, this new defini- 
tion overrides the definition for Python function len. If this is the case, a program cannot 
determine the length of a sequence. As a safeguard, only use import * from modules 
(e.g., Tkinter) that explicitly state that an import * statement may be used. 

Class LabelDemo (lines 6-31) defines the GUI for our program. This class inherits 
from class Frame and serves as the parent Container for three Label components. The 
entire GUI is constructed when a client creates a LabelDemo object and the class’s 

_init _method (lines 9-31) executes. Line 12 calls the base class Frame constructor, 

which creates a top-level component for the entire application and initializes the Frame. 

Once a component has been created and initialized, the component must be placed into 
its parent Container (e.g., the top-level component created by the call to the base class con¬ 
structor). Method pack (line 15) and its keyword arguments specify how and where the 
component should be placed in its parent. Each parent component has a certain amount of 
space into which child components can be placed, and each child has an original default 
size. When method pack executes, a layout manager determines the size and location of 
the child component, based on the available space in the parent Container. We discuss 
layout managers in detail in Section 10.10.1. 

The keyword argument values for method pack influence the size of the component. 
Keyword argument fili specifies how much space the component occupies, beyond its 
default size. Possible values for fili are X (all available horizontal space), Y (all available 
vertical space), BOTH (both vertical and horizontal available space) and NONE (the default 
value—occupies no additional space). Once all child components have been placed in their 
parent, the parent may stili have available space. Keyword argument expand specifies 
whether a child component should occupy any extra space in its parent component (i.e., any 
space not yet occupied by other components). The keyword takes a value of either YES 
(expand to occupy extra space) or NO (do not expand to occupy extra space). The Label¬ 
Demo object occupies all available space provided by its parent (top-level) component 
because options expand and fili are set to YES and BOTH, respectively (line 15). 
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Look-and-Feel Observation 10.2 


Ifno options are set, method pack uses is default settings to places components in a GUI. If 
a programmer desires to alter the position ofa component, the programmer changes the key- 
word arguments. 



Good Programming Practice 10.1 

Before using a GUI class, read the Python Online documentation to leam the methods and 
options ofthe class to understand its capabilities. 


Every child component has an attribute called master that references the child’s 
parent component. Line 16 accesses the LabelDemo’s parent (top-level) component and 
calls method title to change the title of the GUI to Labeis, which then appears in the 
GUI title bar. 

Line 18 creates a Label object. Each GUI component’s class constructor takes a first 
argument that corresponds to the new object’s parent. In this case, self is the first argu- 
ment, indicating that the Label is a child of the LabelDemo component. The value of 
keyword argument text indicates the contents of the Label component. Method pack 
(line 21) inserts Labell into the GUI, using the default settings. By default, Labell 
occupies the top of the window. 

Lines 23-24 create a second Label component. Line 27 calls method pack and 
passes a value for keyword argument side, which describes where the new component is 
placed. Value LEFT indicates that Label2 appears against the left side of the window. 
Other possible values for the side option are BOTTOM, RIGHT and TOP (the default set- 
ting). These options also determine the placing and sizing of child components when the 
parent Container resizes. Ligure 10.4 displays the resulting arrangement after the window 
size increases. As specified by the side option, labell remains at the top of the Container, 
while label2 and label3 stay at the left side of the Container. Section 10.10.1 discusses 
different settings for method pack and the effects of resizing parent containers. 

A Labeis can display an image when a programmer specifies values for the keyword 
argument bitmap. Lor example, a value of "warning" (line 30) displays a warning 
bitmap image on label3. Ligure 10.5 lists other values for bitmap that are available 


Bitmap Image Na me Image 

Bitmap Image Na me Image 

error O 

hourglass 


© 

gray75 

info 

gray50 

questhead ^9*- 


Fig. 10.5 Bitmap ima gesa vaila ble. (Part 1 of 2.) 
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Bitmap Image Na me Image 

Bitmap Image Name Image 

gray25 

question ^ 

gray!2 

warning 


Fig. 10.5 Bitmap imagesavailable. (Part 2 of 2.) 


In addition to using existing bitmap images, programmers can create images to insert 
in a GUI by using keyword argument image. Note that a hierarchy exists between image. 
bitmap and text keyword arguments (in that order). For example, if an image option is 
specified, any bitmap or text options are ignored. Similarly, if bitmap and text 
options both are specified, the text option is ignored. Label options follow a precedence 
hierarchy—the value of the option with the highest precedence appears on the GUI, and 
other labeis are ignored. Labeis with the highest precedence are image, next is bitmap, 
and the lowest precedence is text. 

The third label component, Label3, has the side option set to LEFT (line 31). This 
setting left-justifies the label against Label2, not against the edge of the GUI. 
Section 10.10.1 offers for more information about how the pack method arranges compo¬ 
nents in a GUI. 

Lines 33-37 introduce a convention common to many GUI programs. Lines 36-37 test 

whether the namespace is "_ main _" and calls function main if the condition is true 

(i.e., the interpreter has been invoked on the file) and false if the file has been imported as 
a module. Function main executes if the program is run by itself, rather than imported as 
a module for use in another program. 

Function main creates a LabelDemo object and calls its mainloop method (line 
34). Method mainloop starts the labelDemo GUI. The method redraws the GUI when 
necessary (e.g., when the user changes the size of the GUI) and sends events to the appro- 
priate components. [Note: We discuss events in Section 10.4.] Method mainloop termi- 
nates when the user destroys (closes) the GUI. 

10.4 Event Handling Model 

GUIs are event driven —GUI components generate events (actions) when users of the pro¬ 
grams internet with the GUIs. Some common interactions include moving a mouse, click- 
ing a mouse button, typing in a text field, selecting an item from a menu and closing a 
window. When a user interaction occurs, an event is sent to the program. GUI event infor¬ 
mation is stored in an object of a class Event. An event-driven program is asynchro- 
nous —the program does not know when events will occur. 

To process a GUI event, a program must bind an event to a graphical component and 
implement an event handler (or callback). A program binds, or associates, an event with a 
graphical component and specifies an action to perform. An event handler is a method that 
is invoked in response to an associated event. 
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When an event occurs, the GUI component with which the user interacted determines 
whether an event handler has been specified for the event. If an event handler has been 
specified, the event handler associated with the event executes. For example, a “rollover” 
event occurs when the user moves the mouse over a component. A program might require 
that the appearance of a label changes (e.g., by changing the background color of the label) 
when a rollover event occurs. In this case, the programmer defines a method that changes 
the label’ s appearance and binds the rollover event to the method. When the user moves the 
mouse over the label, the method executes. 


10.5 Entry Component 

Entry components are areas in which users can enter text or programmers can display a 
line of text. This section demonstrates entry components in a program. When the user types 
text into an Entry component and presses the Enter key, a <Return> event occurs. If an 
event handler is bound to that event for the Entry component, the event is processed. In 
our example, the <Return> event signals that the user has finished entering text in the 
Entry. Figure 10.6 defines class EntryDemo, which creates and manipulates four En¬ 
try text fields. When a user presses the Enter key in the active field, the program display s 
the field’s text. The program contains two Frame objects, each of which contains two En¬ 
try components. 
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# Fig. 10.6: figl0_06.py 

# Entry components and event binding demonstration. 


from Tkinter import * 
from tkMessageBox import * 


class EntryDemo( Frame ): 


def _init_( self ): 


Frame._init_( self ) 

self.pack( expand = , fili = ) 

self.master.title( ) 

self.master.geometry( ) 

self.framel = Frame( self ) 
self.framei.pack( pady = ) 


self.texti = Entry( self.framel, name = ) 

# bind the Entry component to event 

self.texti.bind( , self.showContents ) 

self.texti.pack( side = , padx = ) 


self.text2 = Entry( self.framel, name = ) 






Fig. 10.6 Entry componentsand eventbinding demonstration. (Part lof 3.) 
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# insert text into Entry component text2 

self.text2.insert ( , ) 

self.text2.bind( , self.showContents ) 

self.text2.pack( side = , padx = ) 

self.frame2 = Frame( self ) 
self.frame2.pack( pady = ) 

self.text3 = Entry( self.frame2, name = ) 

self.text3.insert ( , ) 

# prohibit user from altering text in Entry component text3 

self.text3.config( state = ) 

self.text3.bind( , self.showContents ) 

self.text3.pack( side = , padx = ) 

# text in Entry component text4 appears as * 

self.text4 = Entry( self.frame2, name = , 

show = ) 

self.text4.insert( , ) 

self.text4.bind( , self.showContents ) 

self.text4.pack( side = , padx = ) 

def showContents( self, event ): 


# acquire name of Entry component that generated event 

theName = event.widget.winfo_name() 


# acquire contents of Entry component that generated event 

theContents = event.widget.get() 

showinfo( , theName + + theContents ) 


def main(): 

EntryDemo() .mainloopO 


if _ name 

main() 






*J 


texti: hello 









Fig. 10.6 Entry components and event bind ing demonstration. (Part 2 of 3.) 
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Fig. 10.6 Entry components and event binding demonstration. (Part 3 of 3.) 


Line 5 imports the class defmitions and constants from module tkMessageBox. 
Module tkMessageBox contains functions that display dialogs , which present messages 
to users. 

Class EntryDemo’s_init _method calls the base class constructor, packs the 

EntryDemo and tities the program (lines 13-15). Method geometry configures the 
length and width of the top-level component in pixels (line 16). Line 18 creates the first 
Frame component, f ramei. The pack method call (line 19) introduces another option, 
pady , which specifies the amount of empty vertical space between f ramei and other GUI 
components in the parent Container. Similarly, option padx, used later in the program, 
specifies the amount of empty horizontal space between components. 

Lines 21 create Entry component texti. Option name assigns a name to Entry. 
We assign a name so the event handler can use that name to identify the component in 
which an event has occurred. 



Look-and-Feel Observation 10.3 


If a name is not specified by the programmer, Tkinter assigns each component a unique 
name. To obtain thefull name of a component, pass the component object tofunction str. 


Method bind (line 24) associates a <Return> event with component texti. A 
<Return> event occurs when the user presses the Enter key. Method bind takes two 
arguments. The first argument is the type of the event (the event format), and the second 
argument is the name of the method to bind to that event. In this example, method show- 
Contents executes when a <Return> event occurs in texti. 

Lines 30-32 create and pack Entry component text2. Method insert writes text 
in the Entry component (line 30). Method insert takes two arguments—a position at 
which text is to be inserted and a string that contains the text to insert. Passing a value of 
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INSERT as the first argument causes the text to be inserted at the cursor’s current position. 
Text also can be inserted at the end of an Entry component. For example, the call 

insert( , text ) 

appends text to the end of text already displayed in the component. 

A program also can delete text from an Entry component with method delete. The 

call 







delete ( start, finish ) 


removes ali text in an Entry component in the range start to finish. If END is the 
second argument, the method removes text up to the end of the text area. The first position 
in an Entry component is position 0; therefore, delete ( 0, END ) removes ali text in 
an Entry component. 

Lines 34-35 creates and packs the second Frame component, f rame2. The program 
packs the Frames one below the other to create two rows into which the Entrys are 
inserted. The program inserts Entry components texti and text2 in framel, while 
text3 and text4 are packed into f rame 2. 

Lines 41-43 create and pack text3 in the same way as the first two Entrys. In this 
case, the component is bound to the <Return> event (line 42). In this example, we dem¬ 
onstrate disabling text3 with method config. Method conf ig allows the user to con- 
figure a component by specifying keyword-value pairs (line 41). Specifying the value 
DISABLED for option state disables the Entry component, preventing the user from 
editing its text. As a resuit, text3 cannot generate a <Return> event. Disabling an 
Entry can be useful to a program that wants to display text but does not want the user to 
edit that text. 

Lines 46-50 create and pack Entry component text4 in the same way as the first 
three Entrys. This component enables the user to enter confidential information. Option 
show specifies a character that will be displayed in the text box instead of the user-entered 
text (line 47). In this example, asterisks (*) appear in place of the default text, "Hidden 
text ". Asterisks also appear in place of any text that the user types into the Entry com¬ 
ponent. 

Method showContents (lines 52-60) is the event handler for each <Return> 
event generated in the Entry components. In Python, most event handlers take as a refer- 
ence to an Event object as an argument; an Event object can have various attributes. The 
component that generated the event is obtained from the object’s widget attribute (i.e., 
event .widget). In our program, event .widget refers to one of the four Entry 
components whose <Return> event is bound to method showContents. 

Common Programming Error 10.1 

Failure to bind an event handler to an event type for a particular GUI component results in 
no events being handledfor that component for that event type. 

Widget method winfo_name (line 56) returns the name of the component. Entry 
method get (line 59) returns the contents of the Entry. The event handler uses both 
return values to construet a message to display to the user. The tkMessageBox function 
showinfo (line 60) displays a dialog box labeled "Message" that contains the name 
and contents of the Entry that generated the event. The screenshots that appear at the end 
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of Fig. 10.6 demonstrate what happens when each Entry component receives the 
<Enter> event. 

10.6 Button Component 

A button is a GUI component that generates an event when it is selected. Buttons facilitate 
and simplify the selection of events by allowing users to select the appropriate button to 
execute an action, instead of manually typing commands. Buttons are created with class 
Button, which inherits from class Widget. The text or image appearing on a Button 
component is a button label. A GUI can display many Buttons, but, typically, each button 
should have a unique button label. 

Look-and-Feel Observation 10.4 

Having more than one Button with the same label results in ambiguity. Provide a unique 
label for each button. 

Figure 10.7 creates two Buttons and demonstrates that Buttons, like Labeis, can 
display both images and text. 








1 

# Fig. 10.7: figl0_07.py 



2 

■3 

# Button demonstration. 



3 

4 

from Tkinter import * 



5 

6 

from tkMessageBox import * 



7 

8 

class PlainAndFancy( Frame ): 



9 

10 

def init ( self ): 



11 




12 




13 

Frame._init_( self ) 



14 

self.pack( expand = , fili = 

) 


15 

self.master.title( ) 



16 




17 

# create button with text 



18 

self.plainButton = Button( self, 

text = 

t 

19 

command = self.pressedPlain ) 



20 

self.plainButton.bind( 

, self.rolloverEnter 

) 

21 

self.plainButton.bind( 

, self.rolloverLeave 

) 

22 

self.plainButton.pack ( side = 

, padx = , pady = 

) 

23 




24 

# create button with image 



25 

self.myImage = Photolmage( file 

= ) 


26 

self.fancyButton = Button( self. 

image = self.myImage, 

27 

command = self.pressedFancy ) 



28 

self.fancyButton.bind( 

, self.rolloverEnter 

) 

29 

self.fancyButton.bind( 

, self.rolloverLeave 

) 

30 

self.fancyButton.pack ( side = 

, padx = , pady = 

) 

31 





Fig. 10.7 Buttons de monstratiori. (Part 1 of 2.) 
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32 def pressedPlain( self ) : 

33 showinfo( , 

34 

35 def pressedFancy( self ): 

36 showinfo( , 

37 

38 def rolloverEnter( self, event ): 

39 event.widget.config( relief = ) 

40 

41 def rolloverLeave( self, event ): 

42 event.widget.config( relief = ) 

43 

44 def main(): 

45 PlainAndFancy().mainloop() 

46 

47 if _ name_ == 

48 main() 



) 

) 








Fig. 10.7 Buttons de monstratiori. (Part2of2.) 


Lines 18-19 create a Button called plainButton. Option text sets the button’s 
label. Key word argument command specifies the event handler that executes when a user 
selects the button. In our example, plainButton’s label is "PlainButton", and its 
event handler is method pressedPlain. 

Lines 20-21 bind methods rolloverEnter and rolloverLeave to plain¬ 
Button events <Enter> and <Leave> events, respectively. The <Enter> event 
occurs when the user places the mouse cursor over the button; the <Leave> event occurs 
when the user removes the mouse cursor from the button. Section 10.8 discusses mouse 
events in detail. 

Many Tkinter components, including Buttons, can display images by specifying 
image arguments to their constructors or their config methods. The image to display 
must be an object of a Tkinter class that loads an image file. One such class is Photo- 
Image , which supports three image formats —Graphics Interchange Format (GIF), Joint 
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Photographic Experts Group (JPEG) and Portable Greymap Format (PGM). File names 
for each of these types typically end with .gif, . jpg (or . jpeg) or .pgm (or .ppm), 
respectively. An additional image class is class Bitma.plma.ge, which supports the 
Bitmap (BMP) image format (.bmp). Line 25 creates a Photolmage object. File 
logotiny. gif contains the image to load and store in the Photolmage object. (This 
file resides in the same directory as the program.) The program assigns the newly created 
Photolmage object to reference myImage. 

Lines 26-27 create fancyButton with image attribute mylmage. As with 
Labeis, the image attribute takes precedence over text and bitmap attributes, and if 
text or bitmap are specified, they are ignored. 

The event handler for fancyButton is pressedFancy. Note that methods 
pressedPlain (lines 32-33) and pressedFancy (lines 35-36) do not take an Event 
object as an argument. This is because Button callbacks do not take Event objects as 
arguments. Without an Event object, a callback cannot determine for which component 
the event occurred; therefore, it is important to specify a separate callback method for each 
Button, to ensure that the calling component can be identified. Methods pressed¬ 
Plain and pressedFancy create the "Message" dialog boxes, which notify users of 
the buttons that generated the events. 



Good Programming Practice 10.2 

Defining a separate callback method for each Button avoids confusiori, ensures desired be- 
havior and makes debugging a GUI easier. 


Methods rolloverEnter (lines 38-39) and rolloverLeave (lines 41-42) 
create a rollover effect for their respective events. A rollover effect changes the appearance 
of a component. Both methods change the relief of the component—how the component 
appears in relation to its surrounding components—for which the event occurred. Method 
rolloverEnter sets the component’s relief option to GROOVE; method roll¬ 
overLeave sets relief to RAISED 



Look-and-Feel Observafion 10.5 


Using rollovers for Buttons provides users with visualfeedbacks alerting them of actions 


that occur iftlie Buttons are selected. 


10.7 Checkbutton and Radiobutton Components 

Tkinter defines two GUI components— Checkbutton and Radiobutton —that 
have on/off or true/false values. Classes Checkbutton and Radiobutton are sub¬ 
classes of Widget. Although they take the same values, class Checkbutton and class 
Radiobutton are used for different situations. We first discuss class Checkbutton. 

A checkbox is a small white square that either is blank or contains a checkmark. When 
a checkbox is selected, a black checkmark appears in the box. There are no restrictions on 
how checkboxes are used—any number of boxes can be selected at a time. The text that 
appears alongside a checkbox is referred to as the checkbox label. 

Figure 10.8 uses two Checkbutton objects to modify the font style of the text dis- 
played in an Entry component. When selected, one Checkbutton applies a bold style, 
and the other applies an italic style. If both are selected, the style of the font is bold and 
italic. Initially, the Checkbuttons are not selected. 
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# Fig. 10.8: figl0_08.py 

# Checkbuttons demonstration. 


from Tkinter import * 
class CheckFont( Frame ): 


def _init_( self ): 


Frame._init_( self ) 

self.pack( expand = , fili = ) 

self.master.title( ) 

self.framel = Frame( self ) 
self.framei.pack() 

self.text = Entry( self.framel, width = , 

font = ) 

self.text.insert ( , ) 

self.text.pack( padx = , pady = ) 


self.frame2 = Frame( self ) 
self.frame2.pack() 


# create boolean variable 

self.boldOn = BooleanVar() 


# create "Bold" checkbutton 

self.checkBold = Checkbutton ( self.frame2, text = 

variable = self.boldOn, command = self.changeFont ) 
self.checkBold.pack( side = , padx = , pady = ) 


# create boolean variable 

self.italicOn = BooleanVar() 


# create "Italic" checkbutton 

self.checkltalic = Checkbutton ( self.frame2, 
text = , variable = self.italicOn, 

command = self.changeFont ) 

self.checkltalic.pack( side = , padx = , pady = ) 


def changeFont( self ): 


desiredFont = 

if self.boldOn.get () : 
desiredFont += 

if self.italicOn.get(): 
desiredFont += 






Fig. 10.8 Checkbuttons font style selection. (Partlof 2.) 
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54 

55 self.text.config( font = desiredFont ) 

56 

57 def main(): 

58 CheckFont().mainloop() 

59 

60 if _ name_ == 

61 main() 






Fig. 10.8 Checkbuttons font style selection. (Part 2 of 2.) 


Lines 19-20 create an Entry component named text. The inserted text, "Watch 
the font style change" (line 21), has font style "Arial 10". The font attribute 
indicates the font of the Entry component. One way of representing a font is by using a 
string containing the font name, size and style. It is possible to specify no font style, in addi- 
tion to specifying multiple font styles. The Online Introduction to Tkinter 


www.pythonware.com/library/tkinter/introduction/x444- 
fonts.htm 


includes a discussion of available fonts and font styles. 

BooleanVar objects, boldOn (line 28) and italicOn (line 36), are Tkinter 
integer variables that have values of either 0 or 1. The option variable requires an object 
of the Tkinter Variable class. Tkinter provides the Variable class from which 
BooleanVar inherits. The Variable class acts as a Container for Python variables. 
Various Tkinter classes use Variable objects to maintain information about a partic- 
ular component. For example, the CheckButton class uses a BooleanVar object to 
store the state —checked or unchecked—of the button. Our program creates and passes 
BooleanVar references to the CheckButton constructors, so the event handlers can 
determine whether the user has selected one or both of the buttons. 

Lines 31-32 create a Checkbutton called checkBold. The text option indicates 
that the text, "Bold", appears next to the checkbox to provide information about the pur- 
pose of the checkbox. The command attribute of a Checkbutton component is the event 
handler that executes when a user selects or de-selects the button. In this case, we specify 
method changeFont as the event handler. The component’s variable option passes 
the BooleanVar object that the component uses to maintain its state information. When 
a user clicks the CheckButton, two things happen—its BooleanVar value changes 
from 0 to 1, or 1 to 0, and the event handler changeFont executes. Lines 38—40 create 
checkltalic, a CheckButton object that behaves similarly to object checkBold. 
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Method changeFont (lines 44-55) initializes string desiredFont to the original 
"Arial 10 " font. Method get (of class BooleanVar) returns the variable’s value. If a 
user selects checkBold, the program appends " bold" to desiredFont (line 50). 
The process repeats for checkltalic, using italicOn. Likewise, if a user selects 
checkltalic, the program appends the string " italic" to desiredFont (line 53). 
Each string begins with a space so that when the style is appended to the font, a space is 
included (e.g., "Arial 10 italic"). The method then calls conf ig to change text’s 
font to desiredFont. 

Radio buttons, created with class Radiobutton, resemble checkboxes because they 
have two States —selected and not selected (also called deselected). Unlike checkboxes, 
radio buttons represent a set of mutually exclusive options—only one radio button in a 
group can be selected at a time. Selecting a different radio button in the group forces ali 
other radio buttons in the group to be deselected. 



Look-and-Feel Observation 10.6 


Use RadioButtons when the user should choose only one option in a group. 



Look-and-Feel Observation 10.7 


Use CheckBoxes when the user should be able to choose multiple options in a group. 


Figure 10.9 is similar to the program in Fig. 10.8 in that the user can alter the font style 
of an Entry’s text. However, this example permits only a single font style in the group to 
be selected at a time, using radio buttons. 


1 # Fig. 10.9: figl0_09.py 

2 # Radiobuttons demonstration. 

3 

4 from Tkinter import * 

5 

6 class RadioFont( Frame ): 

7 """An area of text with Radiobutton controlled font""" 

8 

9 def _init_( self ): 

10 

11 

12 Frame._init_( self ) 

13 self.pack( expand = , fili = ) 

14 self.master.title( ) 

15 

16 self.framel = Frame( self ) 

17 self.framei.pack() 

18 

19 self.text = Entry ( self.framel, width = , 

font = ) 

21 self.text.insert ( , ) 

self.text.pack( padx = , pady = ) 

23 






Fig. 10.9 Radiobuttons selecting fontstyles. (Partlof 2.) 
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self.frame2 = Frame( self ) 
self.frame2.pack() 


fontSelections = 
self.chosenFont = 



StringVar() 


# initial selection 

self.chosenFont.set( fontSelections[ ] ) 


# create group of Radiobutton components with same variable 

for style in fontSelections: 

aButton = Radiobutton( self.frame2, text = style, 
variable = self.chosenFont, value = style, 
command = self.changeFont ) 
aButton.pack( side = , padx = , pady = ) 

def changeFont( self ): 


desiredFont = 


if self.chosenFont.get() 
desiredFont += 
elif self.chosenFont.get 
desiredFont += 
elif self.chosenFont.get 
desiredFont += 



self.text.config( font = desiredFont ) 


def main(): 

RadioFont().mainloop() 


if _ name 

main() 






Fig. 10.9 Radiobuttonsselecting font styles. (Part 2 of 2.) 

Sequence fontSelections (lines 27-28) lists several font styles. Lines 29-32 
define a StringVar object, chosenFont , and sets the initial value to the default style, 
"Plain". Like BooleanVar, StringVar is a subclass of Tkinter class Vari¬ 
able, and it acts as a Container for a string variable. Unlike our CheckButtons example. 













































pythonhtpl_10.fm Page 361 Friday, December 14, 2001 2:02 PM 


Chapter 10 


Graphical User Interface Components: Part 1 361 


which uses a BooleanVar to track a button’s state, a grouping of RadioButtons in 
Fig. 10.9 use a StringVar to store the value (i.e., name) of the selected button. Groups 
of RadioButtons modify the same Variable object. To define mutually exclusive groups of 
RadioButtons, programmers must assign one Variable object to each group. When a user 
selects a given radio button, the selected radio button modifies the assigned Variable object 
and class the appropriate event handler. Our event handler (changeFont) retrieves the 
value of the group’s StringVar object to determine the selected button. 

Lines 35-39 create and pack a Radiobutton component for each style in the 
fontSelections list— "Plain", "Bold", "Italic" and "Bold/Italic". The 
for loop assigns a style to each button’s text and value options—the option that 
determines the button’s name. Option text indicates the text to be displayed next to the 
Radiobutton component. Attribute variable associates StringVar object 
chosenFont with each Radiobutton component, and option command registers 
method changeFont as the event handler for each button. When the user clicks a 
Radiobutton, the string contained in the StringVar object is changed to contain the 
button’s value, and method changeFont executes. 

Method changeFont (lines 41-53) initializes string desiredFont to "Arial 
10". If a Radiobutton is selected, changeFont appends the desired style to 
desiredFont. Method get obtains the current value of chosenFont. In this example, 
changeFont uses an if/elif structure to emphasize that, unlike Checkbuttons, 
only one Radiobutton (using the same variable) may be selected at a time. 

10.8 Mouse Event Handling 

This section demonstrates how programs handle mouse events —events that occur as a re¬ 
suit of user interaction with a mouse. Figure 10.10 summarizes several common mouse 
event formats and Fig. 10.11 demonstrates how a GUI program can handle them. Ali 
Tkinter events are described by strings following the pattern <modifier-type-detail>. 
The type (for instance, Button and Return) specifies the kind of event. The prefix Dou- 
ble is an example of a modifier while the specific mouse button is a detail. 


Event format 

Desc riptfon 

<ButtonPress-rc> 

Mouse button n has been selected while the mouse pointer is 
over the component, n may be 1 (left button), 2 (middle button) 
or 3 (right button). (e.g., <ButtonPress-l>). 

<Button-;i>, <n> 

Shorthand notations for <ButtonPress-n>. 

<ButtonRelease-/7> 

Mouse button n has been released. 

<B/i-Motion> 

Mouse is moved with button n held down. 

<Prefix-Button-n> 

Mouse button n has been Prefix clicked over the component. 

Prefix may be Double or Triple. 

<Enter> 

Mouse pointer has entered the component. 

<Leave> 

Mouse pointer has exited the component. 


Fig. 10.10 Mouse event formats. 
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# Fig. 10.11: figlO_ll.py 

# Mouse events example. 

from Tkinter import * 
class MouseLocation( Frame ): 

def _init_( self ): 


Frame._init_( self ) 

self.pack( expand = , fili = ) 

self.master.title( ) 

self.master.geometry( ) 


self.mousePosition = StringVar() # displays mouse position 
self.mousePosition.set( ) 

self.positionLabel = Label( self, 

textvariable = self.mousePosition ) 
self.positionLabel.pack( side = ) 


# bind mouse events to window 


self.bind( 
self.bind( 
self.bind( 
self.bind( 
self.bind( 


, self.buttonPressed ) 

, self.buttonReleased 
self.enteredWindow ) 
self.exitedWindow ) 

, self.mouseDragged ) 


) 



def buttonPressed( self, event ): 


self.mousePosition.set( 

+ str( event.y ) + ) 


+ str( event.x ) + 


def buttonReleased( self, event ): 


self.mousePosition.set( 

+ str( event.y ) + ) 

def enteredWindow( self, event ): 


+ str ( event.x ) + 


self.mousePosition.set( 
def exitedWindow( self, event ): 


) 


self.mousePosition.set( 


) 








Fig. 10.11 Mouse eventsdemonstration. (Part 1 of 2.) 
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52 def mouseDragged( self, event ): 

53 

54 

55 self.mousePosition.set( + str( event.x ) + 

56 + str( event. y ) + ) 

57 

58 def main ( ): 

59 MouseLocation () .mainloopO 

60 

61 if _ name_ == 

62 main() 



Mouse outside window 







Fig. 10.11 Mouse eventsdemonstration. (Part 2 of 2.) 

Lines 17-18 create a StringVar object raousePosition and initializes its value 
to "Mouse outside window". Lines 19-21 create and pack Label position- 
Label with t ext vari abi e option mousePosition. Option textvariable asso- 
ciates the text displayed by a Label component with a StringVar object. Option 
textvariable must be associated with a Tkinter Variable object. (Note that in 
Fig. 10.4 we demonstrated the Label component’s text option which is associated with a 
Python variable.) When the string value of the object—in this case mousePosition— 
changes, the text of the label, positionLabel, is updated. 

Lines 24-28 bind a few common mouse events to the window. An event is generated 
when the left mouse button is selected or released while the mouse pointer is in the window, 
when the mouse pointer enters or leaves the window or when the mouse is moved with the 
left button pressed. 

When a <Button-l> event or a <ButtonRelease-l> event is generated, 
method buttonPressed (lines 30-34) or method buttonReleased (lines 36^4-0), 
respectively, calls method set to change the value of variable mousePosition to 
inform the user of the event. A mouse event’s Event object contains the x- and y-coordi- 
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nates, stored in the x and y attributes of the Event object, that describe where the event 
occurred. 

When a mouse pointer enters the application area, method enteredWindow (lines 
42—45J executes. When a mouse pointer exits the application area, method exited- 
Window (lines 47-50) executes. As the screen captures demonstrate, each method prints 
an appropriate message indicating whether the mouse is over or not over the MouseLo- 
cation object. The methods modify the value in StringVar object mousePosition 
to update the Label’s text. 

Event handler mouseDragged (lines 52-56) is triggered under different circum- 
stances than event handlers buttonPressed and buttonReleased. There are two 
conditions which must be met before a <Bl-Motion> event is triggered: button B1 must 
be pressed and the mouse must be moving. Once these requirements are met, the <B1- 
Motion> event is fired at a rate that is defined by the operating system. In other words, on 
on one operating system, dragging a mouse to the right might trigger 50 <Bl-Motion> 
events, while on a different operating system the rate might be much lower. For each <B1- 
Motion> event, method mouseDragged displays the events and the coordinates from 
which the event originated. 

A mouse may have one, two, or three buttons. A program may need to take different 
actions, depending on which button the user has pressed. Figure 10.12 contains a program 
that demonstrates how to distinguish between different mouse buttons. 


1 # Fig. 10.12: figl0_12.py 

2 # Mouse button differentiation. 

3 

4 from Tkinter import * 

5 

6 class MouseDetails( Frame ): 

7 

8 


9 

def _init_( self ): 


10 


it and bind mouse evei 

11 



12 

Frame._init_( self ) 


13 

self.pack( expand = 

, fin = ) 

14 

self.master.title( 


15 

self.master.geometry( 

) 

16 



17 

# create mousePosition 

variable 

18 

self.mousePosition = StringVar() 

19 

positionLabel = Label( 

self. 

20 

textvariable = self. 

mousePosition ) 

21 

self.mousePosition.set( 

) 

22 

positionLabel.pack( side = ) 

23 



24 

# bind event handler to 

events for each mouse 

25 

self.bind( 

, self.leftClick ) 

26 

self.bind( 

, self.centerClick ) 

27 

self.bind( 

, self.rightClick ) 

28 




Fig. 10.12 Mouse button differentiation. (Part 1 of 2.) 
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def leftClick( self, event ): 


self.showPosition( event.x, event.y ) 

self.master.title( ) 

def centerClick( self, event ): 


self.showPosition( event.x, event.y ) 

self.master.title( ) 

def rightClick( self, event ): 


self.showPosition( event.x, event.y ) 

self.master.title( ) 

def showPosition( self, x, y ): 


self.mousePosition.set( 
str( y ) + ) 

def main(): 

MouseDetails () .mainloopO 

if _ name_ == : 

main() 


+ str( x ) + 


+ 






Fig. 10.12 Mouse button differentiation. (Part 2 of 2.) 

Figure 10.12 is similar to Fig. 10.11 except that lines 25-27 bind methods to events for 
different mouse buttons by changing the number in the event format (<Button-«>). When 
the user presses a button while the mouse pointer is inside the window, the window’s title 
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changes to indicate which button was pressed. Each event handler calls method showPo- 
s it ion (lines 47-51), which displays the coordinates of the mouse event. 

10.9 Keyboaid Event Handling 

This section presents binding event handlers to keyboard events. These events are generat- 
ed when keyboard keys are pressed and released. Figure 10.13 presents all available for- 
mats for keyboard events. 

Figure 10.14 demonstrates binding methods to keyboard events. For clarity, we do not 
use the shorthand notations of <KeyPress> and cKeyPress -key> events. 


Event format 

Desc ription of Event 

<KeyPress> 

Any key has been selected. 

<KeyRelease> 

Any key has been released. 

<KeyP r e s s —key> 

< KeyRe 1 e a s e -key> 

key has been selected or released. 

<Key>, <Key -key> 

Shorthand notation for <KeyPress> 
and <KeyPress -key>. 

<key> 

Shorthand notation for <KeyPress-kev>. This format works 
only for printable characters (excluding space and less-than 
sign). 

<Preflx-key> 

key has been selected while Prefix is held down. Possible pre- 
ftxes are Alt. Shift and Control. Note that multiple pre- 
ftxes are also possible (e.g., <Control-Alt-key>). 


Fig. 10.13 Keyboard event formats. 



1 # Fig. 10.14: figl0_14.py 

2 # Binding keys to keyboard events. 

3 

4 from Tkinter import * 

5 

6 class KeyDemo( Frame ): 

7 """Demonstrate keystroke events""" 

8 

def _ init_( self ): 

10 two Labeis and bind keystroke events""" 

11 

12 Frame._init_( self ) 

13 self.pack( expand = , fili = ) 

14 self.master.title( ) 

15 self.master.geometry( ) 

16 

17 self.messagel = StringVar() 

18 self.linei = Label( self, textvariable = self.messagel ) 






Fig. 10.14 keyboard eventsdemonstrated. (Part 1 of 3.) 
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self.messagel.set( ) 

self.linei.pack() 

self.message2 = StringVar() 

self.line2 = Label ( self, textvariable = self.message2 ) 


self.message2.set( ) 

self.Iine2.pack() 

# binding any key 

self.master.bind( 
self.master.bind( 

# binding specific key 

self.master.bind( 
self.master.bind( 

self.shiftReleased ) 

def keyPressed( self, event ): 


, self.keyPressed ) 

, self.keyReleased ) 

, self.shiftPressed ) 


self.messagel.set( + event.char ) 

self.message2.set( ) 

def keyReleased( self, event ): 


self.messagel.set( 
self.message2.set( 

def shiftPressed( self, event ): 


+ event.char 


) 



) 


self.messagel.set( ) 

self.message2.set( ) 

def shiftReleased( self, event ): 


self.messagel.set( 
self.message2.set( 

def main(): 

KeyDemo().mainloop() 

if _ name_ == 

main() 


) 


) 







Fig. 10.14 keyboard eventsdemonstrated. (Part 2 of 3.) 




































pythonhtpl_10.fm Page 368 Friday, December 14, 2001 2:02 PM 






368 Graphical User Interface Components: Part 1 


Chapter 10 






Fig. 10.14 keyboard eventsdemonstrated. (Part3of 3.) 




Lines 17-25 create and pack two Labeis—linei and line2 —that display infor- 
mation about the key events. Lines 28-29 bind methods keyPressed and keyRe- 
leased to <KeyPress> and <KeyRelease> events, respectively. Method bind 
(lines 32-34) associates the <KeyPress-«> and <KeyRelease-?;> events for the left 
Shift key ( Shift_L ) to methods shiftPressed and shiftReleased, respectively. 

Methods shiftPressed (lines 50-54) and shiftReleased (lines 56-60) dis¬ 
play messages in the Label components when the user presses and releases the left Shift 
key, respectively. If the user selects a key other than the Shift key, methods keyPressed 
and keyReleased display messages in linei and line2 indicating which key gener- 
ated the event. Methods keyPressed and keyReleased obtain the name of the key 
with the char attribute of the Event object. 

. Portability Tip 10.2 

i Not ali systems can distinguish between the left and right Shift keys. 


10.10 LayoutManageis 

Layout managers arrange the placement of GUI components. Most layout managers pro¬ 
vide basic layout capabilities that a programmer can use, rather than having to determine 
the exact position and size of every GUI component. Allowing layout managers to process 
most of the design details enables the programmer to concentrate on the basic “look and 
feel” of the GUI. Figure 10.15 summarizes the available layout managers. 


Layout manager Description 


Pack Places components in the order in which they were added. 

Grid Arranges components into rows and columns. 

Place Allows the programmer to specify the size and location of compo¬ 

nents and Windows. 








Fig. 10.15 GUI layout managers. 
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Good Programming Practice 10.3 

Choosing the best layout manager can make programming a GUI much easier. Before pro¬ 
gramming, draw your design and select the manager that best suits it. 



Common Programming Error 10.2 


Using more than one type of layout manager in the same Container causes the application to 
freeze while Tkinter attempts to reconcile the different demands ofeach manager. 


10.10.1 Pack 


All the previous GUI examples used the most basic layout manager, Pack. Unless a pro- 
grammer specifies a different order, Pack places GUI components in a Container from top 
to bottom in the order in which they listed in the program. A Container is a GUI component 
into which other components may be placed. Containers are useful for managing the layout 
of GUI components. When the edge of the Container is reached, the Container expands, if 
possible. If the Container cannot expand, the remaining components are not visible. 

A programmer has several options when packing components in a Container. Option 
side indicates the side of the Container against which the component is placed. Setting 
side to TOP (the default value) packs components vertically. Other possible values are 
BOTTOM, LEFT (for horizontal placement) and RIGHT. The fili option, which can be 
set to NONE (default), X, Y or BOTH, allots the amount of space the component should 
occupy in the Container. Setting f ili to X, Y or BOTH ensures that a component occupies 
all the space the Container has allocated to it in the specified direction. The expand option 
can be set to YES or NO (1 or 0). The default value is NO. If expand is set to YES, the 
component expands to fili any extra space in the Container. The padx and pady options 
insert padding, or empty space, around a component. The method pack_f orget removes 
a packed component from a Container. 



Good Programming Practice 10.4 

Review the list of options and methods for layout managers found in the Python on-line doc- 
umentation before using layout managers. 


.Common Programming Error 10.3 



Method pack places components in a Container in the order in which they were packed; 
therefore, an incorrect packing order can cause undesired results. Packing components with 
specified values for options side, expand. fili, padx and pady can create the desired 
results regardless of packing order. 


Figure 10.16 creates four Buttons and adds them to the application using the Pack 
layout manager. The example manipulates the button locations and sizes. 

The Frame constructor (line 12) allows the base class to perform any initialization 
that it requires before we add components. Method title (line 13) displays the title in the 
GUI. Method geometry (line 14) sets the width and height to 300 and 150 pixels, respec- 
tively. The expand and fili options (line 15) are set to YES and BOTH, respectively, 
ensuring that the packDemo GUI filis the entire window. The second screen capture illus- 
trates the GUI’s appearance after it has been resized by dragging the borders with the 


mouse. 
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# Fig. 10.16: figl0_16.py 

# Pack layout manager demonstration. 

from Tkinter import * 
class PackDemo( Frame ): 

def _init_( self ): 


Frame._init_( self ) 

self.master.title( ) 

self.master.geometry( ) 

self.pack ( expand = , fili = ) 

self.buttonl = Button ( self, text = 
command = self.addButton ) 

# Button component placed against top of window 

self.buttonl.pack ( side = ) 


self.button2 = Button ( self, 
text = 


) 


# Button component placed against bottom of window 

# filis ali available vertical and horizontal space 

self.button2.pack( side = , fili = ) 


self.button3 = Button ( self, 
text = 


# Button component placed against left side of window 

# filis ali available horizontal space 

self.button3.pack ( side = , expand = , fili = ) 

self.button4 = Button ( self, 

text = ) 


# Button component placed against right side of window 

# filis all available vertical space 

self.button4.pack ( side = , expand = , fili = ) 

def addButton( self ): 


Button( self, text = 


def main(): 

PackDemo().mainloop() 


if _ name 

main() 


).pack( pady = ) 






Fig. 10.16 Pack layout managerdemonstration. (Part 1 of 2.) 
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-=lS|x| 


expand =YES, fili = X 


expand =YES, fili = Y 


expand = NO, fili = BOTH 


Packing Demo 


Add Button 


New Button 


i 


-=lsl *I 


New Button 


expand =YES, fili =X 


expand = YES,fill=Y 


expand = NO, fili = BOTH 


Fig. 10.16 Pack layout managerdemonstration. (Part 2 of 2.) 

Lines 17-42 create and pack four Buttons, specifying different packing options for 
each Button. The Pack layout manager places each item on the top-level component in 
the order that they appear in the program. The specified values for options side, expand 
and fili ensure that the buttons appear as they do in the screenshots. Method pack (line 
21) places buttonl at the top of the Container as specified by option side. Since fili 
and expand are false by default, the Button component maintains its default size. The 
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next component, button2, (line 28) is placed at the bottom of the Container. The fili 
option’s value, BOTH, indicates that the Button component should occupy ali space allo- 
cated to it by the Container. The expand option is set for button3 (line 35). Method 
pack places this component on the left side of the Container. The expand option specifies 
that the button should take any available space in the Container. The X fili option sets the 
button to fili ali horizontal space given to it by the Container. The last component, 
button4, is placed on the right side of the Container. Fili option Y causes the button to fili 
all its allocated vertical space. 

Only one Button—buttonl —specifies a callback method. When the user presses 
buttonl, method addButton (lines 44-47) creates and packs a new Button. The 
newly created Buttons are packed vertically below buttonl and are each padded in the 
vertical direction by five pixels. 


10.10.2 Grid 


The Grid layout manager divides the Container into a grid, so that components can be 
placed in rows and columns. Components are added to a grid at their specified row and 
column indices; every cell in the grid can contain a component. Row and column numbers 
begin at 0. If the row option is not specified, the component is placed in the first empty row 
and the default column value is 0. If the column option is omitted, the column value 
defaults to 0. The programmer may set the initial number of rows and columns in the grid 
by specifying both options in a grid constructor call. In addition, the rows and columns 
can be set with calls to methods rowconf igure and columnconf igure, respectively. 
Figure 10.17 demonstrates the Grid layout manager by placing several types of compo¬ 
nents in the GUI. 


1 # Fig. 10.17: figl0_17.py 

2 # Grid layout manager demonstration. 

3 

4 from Tkinter import * 

5 

6 class GridDemo( Frame ): 


7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 


def _init_( self ): 


Frame._init_( self ) 

self.master.title( 


# main frame filis entire Container, expands if necessary 

self.master.rowconfigure( , weight = ) 

self.master.columnconfigure( , weight = ) 

self.grid( sticky = + + + ) 


self.texti = Text ( self, width = , height = 


Fig. 10.17 Grid layout managerdemonstration. (Part lof 3.) 
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# text component spans three rows and all available space 

self.texti.grid( rowspan = , sticky = + + + ) 

self.texti.insert ( , ) 


# place button component in first row, second column 

self.buttonl = Button ( self, text = , 

width = ) 

self.buttonl.grid( row = , column = , columnspan = 

sticky = + + + ) 


# place button component in second row, 

self.button2 = Button ( self, text = 
self.button2.grid( row = , column = , 


second column 
) 

sticky = + + + 


) 


# configure button component to fili all it allocated space 

self.button3 = Button ( self, text = ) 

self.button3.grid( row = , column = , sticky = + + + ) 


# span two columns starting in second column of first row 

self.button4 = Button( self, text = ) 

self.button4.grid( row = , column = , columnspan = , 

sticky = + + + ) 


# place text field in fourth row to span two columns 

self.entry = Entry( self ) 
self.entry.grid( row = , columnspan = , 

sticky = + + + ) 

self.entry.insert( , ) 


# fili all available space in fourth row, third column 

self.text2 = Text( self, width = , height = ) 

self.text2.grid( row = , column = , sticky = + + + ) 

self.text2.insert ( , ) 


# make second row/column expand 

self.rowconfigure( , weight = ) 

self.columnconfigure( , weight = ) 


def main(): 

GridDemo().mainloop() 


if _ name 

main() 










Fig. 10.17 Grid layout managerdemonstration. (Part 2 of 3.) 
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Fig. 10.17 Grid layout managerdemonstration. (Part 3 of 3.) 

Method grid (line 18) places the top-level component in row 0 and column 0, by 
default. The sticky option for the gridDemo object is W+E+N+S; this causes the main 
frame to expand to fili the entire cell. The sticky option speciftes the component’s align- 
ment and whether the component stretches to fili the cell. Possible values for sticky are 
any combination of W, E, N, S, NW. NE. SW and SE. A sticky value of W+E, for example, 
is similar to setting fili to X when packing a component—the component stretches from 
the left (W) to the right (E) to fili the cell. Setting sticky to W+E+N+S produces results 
similar to those produced by the Pack layout manager’s fili value of BOTH. Specifying 
only one value for sticky is analogous to the side option of Pack —the component 
aligns with the indicated cell border without being stretched. The second screenshot shows 
the GUI after being resized with the mouse. 

The Grid manager supports several methods that control the placement of compo¬ 
nents in the Container. Methods rowconfigure and columnconfigure change row 
and column options, respectively. For example, to ensure that row 0 stretches when the 
window is resized, method rowconfigure (line 16) sets the weight option to 1. The 
weight option indicates the relative weight of growth for a row or column. Weight 
describes the rate at which the row or column grows as the window is resized. For object, 
a row with a weight of three increases at three times the rate of a row whose weight is one. 
The default is 0—cells will not change size if a user resizes the window. Figure 10.18 
describes the most common Grid methods. 


Grid Methods 

Desc ription 

columnconfigure ( column, options ) 

Sets column options, such as minsize (minimum 
size), pad (add padding to largest component in 
the column) and weight. 

grid() 

Places a component in Grid as described by 
optional keyword arguments. 

grid_forget () 

Removes, but does not destroy, a component. 

Fig. 10.18 Grid methods. (Part 1 of 2. 
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Grid Methods 

Desc ription 

grid_remove() 

Removes a component, storing its associated 
options in case the component is re-inserted. 

grid_info() 

Retums current options as a dictionary. 

grid_location ( x, y ) 

Returns the grid position closest to the given pixel 
coordinates as a tuple ( column, row ). 

grid_size() 

Retums the grid size as a tuple ( column, row ). 

rowconfigure ( row, options ) 

Sets row's options, such as minsize (minimum 
size), pad (add padding to largest component in 
the row) and weight. 


Fig. 10.18 Grid methods. (Part 2 of 2.) 


Line 20 introduces the Text component, which creates a multiple-line text area 
texti. Method grid (line 23) inserts component texti into the grid and introduces 
keyword argument rowspan. The rowspan option sets the number of rows that a com¬ 
ponent occupies in the GUI. 

Component buttonl (line 27) spans two columns, as indicated by keyword argu¬ 
ment columnspan. Option columnspan causes a component to sUetch across a speci- 
fied number of columns. Lines 27^-3 create four buttons and explicitly insert each button 
at a certain row and column. 

The Entry component inserted at row 3 (lines 46-49) spans two columns and filis all 
available space in the cell. In line 47, columnspan is assigned 2 and sticky is set to 
W+E+N+S —creating an Entry component that filis the first two columns of row 3. 
Methods rowconfigure and columnconfigure ensure that the second row and 
column expand when a user resizes the window (lines 57-58). 

As in the Pack layout manager, Grid options padx and pady set the size of vertical 
and horizontal padding around a component in a cell. To place padding inside the compo¬ 
nent, use options ipadx and ipady. When a component is smaller than its cell, it is cen- 
tered in the cell by default. 

Common Programming Error 10.4 

It is possible to specify overlapping components. The components that are packed earliest in 
the code are obscured by the most recently added component. 



10.10.3 Place 

The Place layout manager allows the user to set the position and size of a GUI component 
absolutely or relatively to the position and size of another component. The component be- 
ing referenced is specified with the in_ option and may be only the parent of the compo¬ 
nent being placed (default) or a descendant of its parent. 

Layout manager Place is more complicated than the other managers. For this reason, 
we do not discuss the Place layout manager in detail, although Fig. 10.19 lists the most 
common Place methods. Figure 10.20 lists the common place and place_conf igure 
method options. For more information on layout manager Place, visit www. python. org. 
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Place Method 

Descriptiori 

place () 

place_forget() 

place_info() 

place_configure() 

Inserts a component as specified by keyword arguments. 

Removes, but does not destroy, a component. 

Retums current options in a dictionary. 

Positions a component as specified by keyword arguments. 


Fig. 10.19 Place method & 


Place Oplion Descriptiori 


x 

y 

relx 

rely 

width 

height 

relwidth 

relheight 

in_ 


anchor 


Designates the absolute horizontal position of the component. 

Designates the absolute vertical position of the component. 

Indicates the horizontal position of the component, relative to that of another 
component. 

Specifies the vertical position of the component, relative to that of another 
component. 

Specifies the absolute width of the component. 

Indicates the absolute height of the component. 

Specifies the width of the component, relative to that of another component. 
Specifies the height of the component, relative to that of another component. 
Specifies a reference component. The newly inserted component, which 
must be a sibling or a child of the reference component, is placed relative to 
it. 

Indicates which part of the component to “fix” at the given position. Possible 
values are NW (default), N, NE, E. SE, S, SW, W and CENTER. 


Fig. 10.20 Place options. 


10.11 Carcl Shuffling and Dealing Simulatiori 

In this section. we use random number generation to develop a card shuffling and dealing 
simulation program. This program then can be used to implement programs that play spe- 
cific card games. 

We develop GUI class Deck (Fig. 10.21), which creates a deck of 52 playing cards 
using Card objects, then enables the user to deal each card by clicking on a "Deal 
card" button. Each card dealt is displayed in a Label. The user can shuffle the deck at 
any time by clicking on a "Shuffle cards" button. 

Class Card (lines 7-26) contains two lists— faces and suits —that store every 
possible card face and suit. The constructor for the class (lines 17-21) receives a string from 

list faces and a string from list suits. Method_ str _(lines 23-26) returns a string 

consisting of the face of the card, the string " of " and the suit of the card. 
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Class Deck (lines 32-95) consists of a list deck of 52 Card objects, an integer cur- 
rentCard representing the most recently dealt card in the deck list and the GUI compo¬ 
nents used to manipulate the deck of cards. The constructor uses the for structure (lines 
41-43) to fili the deck list with Card objects. Each Card is instantiated and initialized 
with two strings—one from the faces list (Strings "Ace" through "King") and one 
fromthe suits list ("Hearts", "Diamonds", "Clubs" and "Spades"). Note that 
the lists are referenced as Card. faces and Card. suits, respectively, because they 
are class attributes of class Card. The calculation i % 13 always results in a value from 0 
to 12 (the thirteen subscripts of the faces list), and the calculation i / 13 always results 
in a value from 0 to 3 (the four subscripts in the suits list). 







1 

# Fig. 11.21: figll_21.py 




2 

# Card shuffling and dealing 

program 



3 





4 

import random 




5 

from Tkinter import * 




6 





7 

class Card: 




8 

"""Class that represents 

one playin 

g card"" 


9 





10 

# class attributes faces 

and suits 

contain 

strings 

11 

# that correspond to card 

face and 

suit values 

12 

faces = [ , , 

i". 


'Five" , 

13 

/ r 

r 

I 

r 

14 

t 

, ] 



15 

suits = [ , 



1 

16 




17 

def init ( self, face, 

suit ): 



18 




as strings""" 

19 





20 

self.face = face 




21 

self.suit = suit 




22 





23 

def str ( self ): 




24 





25 





26 

return % ( 

self.face, 

self.suit ) 

27 





28 

class Deck ( Frame ) : 




29 





30 





31 

def init ( self ): 




32 





33 





34 

Frame._init_( self ) 




35 

self.master.title( 

rd Dealing 

Program 

) 

36 





37 

self.deck = [] 

of card objects 


38 

self.currentCard = 

# index of 

current 

card 

39 






Fig. 10.21 Card-dealing program. (Part 1 of 3.) 
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70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 
81 
82 

83 

84 

85 

86 

87 

88 

89 

90 


# create deck 

for i in range( ): 

self.deck.append( Card( Card.faces[ i % ], 

Card.suits[ i / ] ) ) 

# create buttons 

self.dealButton = Button( self, text = 
width = , command = self.dealCard ) 

self.dealButton.grid( row = , column = ) 

self.shuffleButton = Button( self, text = 
width = , command = self.shuffle ) 

self.shuffleButton.grid( row = , column = ) 

# create labeis 

self.messagel = Label ( self, height = , 

text = ) 

self.messagel.grid( row = , columnspan = ) 

self.message2 = Label ( self, height = , 

text = ) 

self.message2.grid( row = , columnspan = ) 

self.shuffle() 
self.grid() 

def shuffle ( self ) : 


self.currentCard = 

for i in range( len( self.deck ) ): 
j = random.randint( , ) 

# swap the cards 

self.deck[ i ], self.deck[ j ] = \ 
self.deck[ j ], self.deck[ i ] 

self.messagel.config( text = ) 

self.message2.config( text = ) 

self.dealButton.config( state = ) 

def dealCard( self ): 


# display the card, if it exists 

if self.currentCard < len( self.deck ): 
self.messagel.config( 

text = self.deck[ self.currentCard ] ) 
self.message2.config( 

text = % self.currentCard ) 









Fig. 10.21 Card-dealing program. (Part2of 3.) 
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91 

else : 


92 

self.messagel.config( 

text = 

93 

self.message2.config( 

text = 

94 


) 

95 

96 

self.dealButton.config( state = ) 

97 

98 

self.currentCard += 

increment card for next turn 

99 

def main(): 


100 

101 

Deck() .mainloopO 


102 

if _ name_ == : 


103 

main() 











Fig. 10.21 Card-dealing program. (Part3of 3.) 

When the user clicks the Deal card button, method dealCard (lines 82-95) gets the 
next card in the list. If currentCard is less than 52 (the length of deck), lines 87-88 dis- 
play the face and suit of the card in Label messagel. Label message2 (lines 89-90) 
displays the number of the card (currentCard). If there are no more cards to deal (i.e., 
currentCard is greater than or equal to 52), the string "NO MORE CARDS TO 
DEAL" is displayed in messagel and string "Shuffle cards to continue" is displayed 
in message2. 

When the user clicks the Shuffle cards button, method shuffle (lines 66-80) 
shuffles the cards. The method loops through ali 52 cards (list subscripts 0 to 51). For each 
card, a number between 0 and 51 is picked randomly. Next, the current Card object and 
the randomly selected Card object are swapped in the list. A total of only 52 swaps are 
made in a single pass of the entire list, and the list of Card objects is shuffled! When the 
shuffling is complete, "DECK IS SHUFFLED" is displayed in a Label. 

10.12 Intemetand World Wide Web Resources 

This section presents several Internet and World Wide Web resources related to using mod¬ 
ule Tkinter with Python. 

faqts.com/knowledge_base/index.phtml/fid/264 

This python. faqts page contains questions and answers conceming Tkinter and Python inter- 
action. 




















































pythonhtpl_10.fm Page 380 Friday, December 14, 2001 2:02 PM 






380 Graphical User Interface Components: Part 1 Chapter 10 

faqts.com/knowledge_base/index.phtml/fid/265 

This page lists questions and answers concerning handling events. 

www.pythonware.com/library/tkinter/introduction 

Fredrik LundlTs An Introduciion to Tkinter offers information about Widget classes and event han¬ 
dling. 

www.python.org/topics/tkinter 

This Web page provides links to documentation about Tkinter, additional Widget classes and 
troubleshooting tips. 

www.esis.hku.hk/~kkto/doc-tkinter/tkinter/tkinter.html 

Isaac K. K. To’s Building GUI Programs Using Tkinter: A Tkinter Manual provides information 
about layout managers, events, the Widget class and subclasses. 







SUMMARY 

• A graphical user interface (GUI) presents a pictorial interface to a program. 

• A GUI (pronounced “GOO-eE”) gives a program a distinctive “look” and “feel.” 

• By providing different applications with a consistent set of intuitive user-interface components, 
GUIs allow the user to spend less time trying to remember which keystroke sequences do what and 
spend more time using the program in a productive manner. 

• GUIs are built from GUI components (sometimes called Controls or widgets—shorthand for win- 
dow gadgets). 

• A GUI component is an object with which a user interacts via a mouse or a keyboard. 

• The Tkinter module is the most frequently used module for programming graphical user inter- 
faces in Python. 

• The Tkinter library provides an interface to the Tk (Tool Kit) GUI toolkit-the graphical inter¬ 
face development tool for the Tool Command Language (TCL). 

• Tkinter implements each Tk GUI component as a class that inherits from class Widget. 

• All Widgets have common attributes and behaviors. 

• A GUI consists of a top-level component that may contain more GUI components. The top-level 
component is the parent component. The remaining components are children of the top-level com¬ 
ponent and each child of the top-level component may itself contain children (descendants of the 
parent component). A program builds a GUI from the top-level component by creating new com¬ 
ponents and placing each new component in its parent. 

• Inheriting from class Frame extends the GUTs functionality. This inheritance enables the reuse 
of components in other GUI programs and promotes object-orientation in GUI programs. 

• The Tkinter module, like the rest of Python, is portable across many platforms. 

• Labeis display text or images and usually provide instructions or other information on a graphical 
userinterface. 

• The Frame constructor initializes the Frame and creates a top-level component into which the 
Frame is placed. 

• The creation of a GUI object initially does not display it on the screen. The program must specify 
where and how to draw the object. 

• Method pack places components in the GUI. 

• Keyword argument fili specifies how much available space the component occupies, beyond 
the component’s default size. Possible values for fili are X (all available horizontal space). Y (all 
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available vertical space), BOTH (both vertical and horizontal available space) and NONE (the de- 
fault value—do not take up available space). 

• Keyword argument expand specifies whether a child component should take up any extra space in 
its parent component (i.e., any space not yet occupied once ali other components have been placed). 

• Each GUI component’s class constructor takes a first argument that corresponds to the new ob- 
ject’s parent. 

• The value of keyword argument text specifies the contents of the Label component. 

• The keyword argument side describes where the new component is drawn. Value LEFT speci¬ 
fies that a component is placed against the left side of the window. Other possible values for the 
side option are BOTTOM, RIGHT and TOP, the default setting. 

• Many components display images by specifying a value for the keyword argument bitmap. 

• Keyword argument image inserts a programmer-defined image. Label options have the following 
precedence, from highest to lowest: image, bitmap and text. Each Label component dis- 
plays only one bitmap, image or text message. The value of the option with the highest precedence 
appears on the GUI. Any other values are ignored. 

• If the interpreter is running the program, method mainloop method starts the GUI, redraws the 
GUI as needed and sends events to the appropriate components. It terminates when the user de- 
stroys (closes) the GUI. 

• GUIs are event driven (i.e., they generate events when the user of the program interacts with the 
GUI). Some common interactions are moving the mouse, clicking a mouse button, typing in a text 
field, selecting an item from a menu and closing a window. When a user interaction occurs, an 
event is sent to the program. 

• GUI event information is stored in an object of a class Event. 

• An event-driven program is asynchronous—the program does not know when events will happen. 

• To process a GUI event, the programmer must perform two key tasks—bind an event to a graph¬ 
ical component and implement an event handler. A program explicitly binds, or associates, an 
event with a graphical component and specifies an action to perform when that event occurs. Typ- 
ically, the action is performed by an event handler—a method that is called in response to its as- 
sociated event. 

• When an event occurs, the GUI component with which the user interacted determines whether an 
event handler has been specified for the event. If an event handler has been specified, that event 
handler exeeutes. The program can specify an event handler that exeeutes when this event occurs. 

• Entry components are areas in which users can enter or programmers can display a single line 
of text. 

• When the user types data into an Entry component and presses the Enter key, a <Return> 
event occurs. If an event handler is bound to that event for the Entry component, the event is 
processed and the data in the Entry can be used by the program. 

• Module tkMessageBox contains functions that display dialogs. Dialogs present messages to the 
user. 

• Method geometry specifies the length and width of the top-level component in pixels. 

• Option pady of method pack specifies the amount of empty vertical space between GUI compo¬ 
nents. Similarly, option padx specifies the amount of empty horizontal space between components. 

• The Ent ry constructor’ s width argument specifies that 20 columns of text can appear in the text 
area on the GUI, although the Entry component accommodates larger inputs. The width of the 
text field will be the width, in pixels, of the average character in the text field's current font mul- 
tiplied by 20. 
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• Option name assigns a name to the Entry. A program can use the name to identify the component 
in which an event has occurred. 

• Method bind associates an event with a component. Method bind takes two arguments. The first 
argument is the type of the event, and the second argument is the name of the method to bind to 
that event. 

• Method insert writes text in the Entry component. Method insert takes two arguments— 
a position at which text is to be inserted and a string that contains the text to insert. 

• Passing a value of INSERT as the first argument to method insert causes the text to be inserted 
at the cursor’s current position. 

• Method call insert ( END, text ) appends text to the end of any text already displayed in 
the component. 

• Method call delete ( start, f inish ) removes all text in an Entry component in the range 
start to f inish. Using END as the second argument removes text up to the end of the text area. 
The first position in an Entry component is position 0; delete ( 0. END ) removes all text in 
an Entry component. 

• Method config configures a component’s options. 

• Specifying the value DISABLED for option state disables the Entry component, preventing 
the user from editing its text. 

• Option show sets the character that appears in place of the actual text. 

• Most event handlers take as an argument an Event object, which has various attributes. The com¬ 
ponent that generated the event is obtained from the widget attribute of the Event object (i.e., 

event. widget). 

• Widget method winfo_name and Entry method get acquire the name and contents of an 
Entry, respectively. 

• The tkMessageBox function showinfo displays a dialog box. 

• A button is a component the user clicks to trigger a specific action. A button generates an event 
when the user clicks the button with the mouse. 

• Buttons are created with class Button, which inherits from class Widget. 

• The text or image on the face of a Button component is called a button label. 

• Buttons (likc Labeis) can display both images and text. 

• Option text sets the button’s label. 

• Keyword argument command specifies the event handler (or callback) that is invoked when the 
button is selected. 

• Many Tkinter components, including Buttons, can display images by specifying an image 
argument to their constructor or their config method. 

• A specified image must be an object of a Tkinter class that loads an image file. One such class 
is Photolmage, which supports three image formats—Graphics Interchange Format (GIF), Joint 
Photographic Experts Group (JPEG) and Portable Greymap Format (PGM). File narnes for each 
of these types typically end with . gif . . jpg (or . jpeg) or . pgm (or . ppm), respectively. 

• Class is Bitmaplmage supports the Bitmap (BMP) image format (.bmp). 

• As with Labeis, the image attribute of a Button component takes precedence over text and 
bitmap attributes. 

• The relief option of the Buttons is changed to GROOVE or RAISED to create rollover effects. 

• Tkinter contains two GUI components— Checkbutton and Radiobutton —that have on/ 
off or true/false values. 



































pythonhtpl_10.fm Page 383 Friday, December 14, 2001 2:02 PM 






Chapter 10 


Graphical User Interface Components: Part 1 383 







• Classes Checkbutton and Radiobutton are subclasses of Widget. 

• A Radiobutton is different than a Checkbutton in that there are normally several Ra- 
diobuttons that are grouped together, and only one of the Radiobuttons in the group can 
be selected (true) at any time. Radio buttons are used to represent a set of mutually exclusive op- 
tions (i.e., multiple options in the group cannot be selected at the same time). 

• Entry fonts are specified using the f ont attribute. One way of representing a font is a string con- 
taining the name, size and style of the font. It is possible to specify no font style, as well as more 
than one font style. 

• BooleanVar objects are Tkinter integer variables that have value 0 or 1. 

• Tkinter provides a Variable class from which BooleanVar inherits. The Variable class 
acts as a Container for Python variables. 

• The CheckButton class uses a BooleanVar object to store the state—checked or un- 
checked—of the button. 

• StringVar. like BooleanVar, is a subclass of Tkinter class Variable. A StringVar 

object acts as the interface to a string variable. 

• Attribute variable associates chosenFont with each Radiobutton component. 

• Keyword argument value specifies the value to assign to the associated variable when a radio 
button is selected. 

• All Tkinter events described by strings follow the pattern <modifier-lype-detail>. The type 
specifies the kind of event. 

• An Event object for a mouse event contains information about the mouse event that occurred, 
including the x- and y-coordinates of the location where the event occurred. The x- and y-coordi- 
nates of the location of the mouse pointer when the event occurred are stored in the x and y at- 
tributes of the Event object. 

• The name of a selected key can be obtained with the char attribute of the Event object. 

• Layout managers arrange GUI components on a Container for presentation purposes. Most layout 
managers provide basic layout capabilities that are easier to use than determining the exact posi- 
tion and size of every GUI component. 

• Letting layout managers process most of the layout details enables the programmer to concentrate 
on the basic “look and feel” of the GUI. 

• Pack is the most basic layout manager. GUI components are placed on a Container from top to 
bottom in the order in which they are added to the Container (unless otherwise specified). When 
the edge of the Container is reached, the Container is expanded (if possible), or the remaining com¬ 
ponents are not visible. 

• A programmer can specify several options when packing components in a Container. 

• The padx and pady options place padding around the component. 

• To remove a packed component from a Container, use the component’s pack_forget method. 

• Method title displays the title in the GUI. 

• Method geometry sets the width and height of a GUI. 

• The Grid layout manager divides the Container into a grid, so that components can be placed in 
rows and columns, where the numbering of the rows and columns starts at 0. 

• Every cell in the grid can contain a component. 

• Components are added to a grid at their specified row and column indices. If the row option is 
not specified, the component is placed in the first empty row. The default column value is 0. 
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• The sticky option specifies the componenfs alignment or stretches the component to fili the 
cell. Possible values for sticky are any combination of W, E, N. S, NW. NE, SW and SE. 

• A sticky value of W+E is similar to setting f ill to X when packing a component—the compo¬ 
nent stretches from the left (W) to the right (E). The component stretches horizontally to fili the cell. 

• Setting sticky to W+E+N+S produces results similar to those produced by a f ill value of BOTH. 

• Specifying only one value for sticky is analogous to the side option of Pack. The component 
aligns to the specified cell border without being stretched. 

• The Grid manager, the component into which other components have been placed, supports sev- 
eral methods that control the grid. 

• Methods rowconf igure and columnconf igure change options of rows and columns, re- 
spectively. 

• The weight option specifies the relative weight of growth for a row or column. The default is 0, 
therefore, cells will not change size if the window is resized unless the weight option has been 
changed. 

• The Text component creates a multiple-line text area. 

• The rowspan option sets the number of rows that a component occupies in the GUI. 

• Option columnspan causes a component to span the specified number of columns. 

• As in the Pack layout manager, Grid options padx and pady specify the size of vertical and 
horizontal padding around a component in a cell. 

• To place padding inside the component, use options ipadx and ipady. If a component is smaller 
than its cell, it is centered in the cell by default. 

• The Place layout manager allows the user to set the position and size of a GUI component in 
relation to the position and size of another component relatively or absolutely. The component be¬ 
ing referenced is specified with the in_ option and may be only the parent of the component being 
placed (default) or a descendant of its parent. 

• The Place layout manager is more complicated than the other managers, so most programmers 
prefer to use the other, more simpler managers. 

TERMINOLOGY 

anchor option of layout rnanger Place 
bitmap image 

bitmap option of Button component 
bitmap option of Entry component 
Bitmaplmage class 
<B/;-motion> event 
BooleanVar class 

BOTTOM value of option side of method pack 
Button component 
button label 
<Button-»> event 
<ButtonPress-n> event 
<ButtonRelease-n> event 
callback 

CENTER value of option anchor of 
layout manger Place 
char attribute of the Event object 
check box 



Checkbutton component 
children 

columnconf igure method of 
layout manager Grid 
column option of method grid 
columnspan option of method grid 
conf ig method of class Widget 
E value of option anchor of 
layout manger Place 
E value of option sticky of method grid 
<Enter> event 
Entry component 
Event class 
event handler 

expand option of method pack 
fili option of method pack 
font attribute of component Entry 
Frame component 
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geometry method 
get method of class BooleanVar 
get method of Entry component 
Graphical User Interface (GUI) 

Grid layout manager 
grid method 
grid_forget method 
grid_info method 
grid_location method 
grid_remove method 
GUI component 

height option of layout manger Place 
image option of component Label 
in_ option of layout manger Place 
insert method of Entry component 
ipadx option of method grid 
ipady option of method grid 
<Key> event 
keyboard event 
<Key -key> event 
<KeyPress> event 
<KeyPress-key> event 
<KeyRelease> event 
<KeyRelease-fa'y> event 
Label component 
layout manager 
<Leave> event 

LEFT value of option side of method pack 

Listbox component 

mainloop method 

menu 

menu bar 

Menu component 

Menubutton component 

mouse event 

N value of option anchor of 
layout manager Place 
N value of option sticky of method grid 
<n> event 

name option of component Entry 
NE value of option anchor of 
layout manager Place 
NE value of option sticky of method grid 
NO value of option expand of method pack 
NONE value of option f i 11 of method pack 
NW value of option anchor 
layout manager Place 
NW value of option sticky of method grid 
Pack layout manager 
pack method 


pack_forget method 
padx option of method pack 
pady option of method pack 
parent component 
Photo Image class 
Place layout manager 
place method 
place_forget method 
place_info method 
<Prefix-Button-u> event 
<P r e f lx—key> event 
radio button 

Radiobutton component 
relheight option of layout manager Place 
relief option of component Button 
relwidth option of layout manager Place 
relx option of layout manager Place 
rely option of layout manager Place 
<Retum> event 

RIGHT value of option anchor of 
layout manager Place 
row option of method grid 
rowconf igure method of 
layout manger Grid 
rowspan option of method grid 
S value of option anchor of 
layout manager Place 
S value of option sticky of method grid 
Scale component 
Scrollbar component 
SE value of option anchor of 
layout manger Place 
SE value of option sticky of method grid 
set method of class StringVar 
show option of component Entry 
showinf o function of module 
tkMessageBox 
side option of method pack 
state option of component Entry 
sticky option of method grid 
StringVar class 
SW value of option anchor of 
layout manager Place 
SW value of option sticky of method grid 
Text component 
text option of component Label 
textvariable option of component Label 
textvariable option of component 
Radiobutton 
title method 
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Tk (Tool Kit) 

Tkinter module 
tkMessageBox module 
Tool Command Language (TCL) 

TOP value of option side of method pack 
top-level component 

value option of component Checkbutton 
value option of component Radiobutton 
variable option of component 

Checkbutton 

variable option of component 

Radiobutton 


W value of option anchor of 
layout manager Place 
W value of option sticky of method grid 
weight option of layout manager Grid 
Widget class 

width option of layout manager Place 
winf o_name method of class Widget 
X option of layout manager Place 
x value of option f ill of method pack 
Y option of layout manager Place 
y value of option f ill of method pack 
YES value of option expand of method pack 


SELF-REVIEW EXERCISES 

10.1 Fili in the blanks in each of the following: 

a) A_presents a pictorial user interface to a program. 

b) Labeis are defined with class_— a subclass of_. 

c) _are single-line areas in which text can be displayed. 

d) Method_displays text in an Entry. 

e) Method_displays a message dialog. 

f) A_is a Container for other components. 

g) Use method_of class_to acquire the name of an Entry. 

h) _ arrange GUI components on a Container for presentation purposes. 

i) A_is a component that the user clicks to trigger an action. 

j) The_places components in the specified row and column. 

10.2 State whether each of the following is true or false. If false, explain why. 

a) Ali Tkinter classes inherit from Frame. 

b) A Label displays only text. 

c) The Entry component creates multiple-line text areas. 

d) When the user types data into an Entry and presses the Enter key, an <Enter> event 
occurs. 

e) Tkinter Button components display images using method img. 

f) Class Photolmage supports GIF, IPEG and PGM images. 

g) Only one Radiobutton can be selected at a time. 

h) Boolean objects are Tkinter integer variables that can have a value of 0 or 1. 

i) Event format <Left> handles the event in which a mouse pointer has exited the com¬ 
ponent. 

j) Layout managers arrange the placement of GUI components. 


ANSWERS TO SELF-REVIEW EXERCISES 

10.1 a) graphical user interface (GUI), b) Label. Widget. c) Entrys. d) insert. e) show- 
inf o. f) Frame. g) winf o_name, Widget. h) Layout managers. i) button. j) Grid layout manager. 

10.2 a) False. All Tkinter classes inherit from Widget. b) False. A Label can display text or an 
image. c) False. The Entry component creates single-line text areas. A Text widget creates multi- 
ple-line text areas, d) False. When the user types data into an Entry and presses the Enter key, a 
<Return> event occurs. e) False. Tkinter Button components display images using method 
image. f) True. g) True. h) False. BooleanVar objects are Tkinter integer variables that can 
have a value of 0 or 1. i) False. Event format <Leave> handles the event in which a mouse pointer 
has left the component, j) True. 
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EXERCISES 


10.3 Create the following GUI using the Grid layout manager. You do not have to provide any 
functionality. 



10.4 Write a temperature conversion program that converts Fahrenheit to Celsius. Use the Pack 
layout manager. The Fahrenheit temperature should be entered from the keyboard via an Entry 
component. A tkMessageBox should display the converted temperature. Use the following formu¬ 
la for the conversion: 

Celsius = 5 / 9 * (Fahrenheit - 32) 

10.5 Enhance the temperature conversion program of Exercise 10.4 by adding the Kelvin temper¬ 
ature scale. The program should also allow the user to make conversions between any two scales. Use 
the following formula for the conversion between Kelvin and Celsius (in addition to the formula in 
Exercise 10.4): 

Kelvin = Celsius + 273 

10.6 Add functionality—addition, subtraction, multiplication and division—to the calculator cre- 
ated in Exercise 10.3. Use the built-in Python function eval to evaluates strings. For instance, 
eval ( "34+24" ) retums the integer 58. 

10.7 Write a program that allows the user to practice typing. When the user clicks a button, the 
program generates and displays a random sequence of letters in an Entry component. The user re- 
peats the sequence in another Entry component. When the user enters an incorrect letter, the pro¬ 
gram displays an error message until the user types the correct letter. Use keyboard events. 

10.8 Create a GUI for a matching game. Initially, buttons should cover pairs of images. When the 
user clicks a button, the image displays. If the user finds a matching pair, disable the buttons and dis¬ 
play their images. If the user’s choices do not match, hide the images. 
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Objectives 

• To create a scrolled list of items from which a user can 
make a selection. 

• To create scrolled text areas. 

• To create menus and popup menus. 

• To create and manipulate canvases and scales. 

I claim not to have controlled events, but confessplainly that 
events have controlled me. 

Abraham Lincoln 

A good symbol is the best argument, and is a missionary to 
persuade thousands. 

Ralph Waldo Emerson 
Capture its reality in paint! 

Paul Cezanne 
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Outiine 

11.1 Introduction 

11.2 OverView ofPmw 

11.3 ScrolledListbox Component 

11.4 ScrolledText Component 

11.5 MenuBar Component 

11.6 Fopup Menus 

11.7 Canvas Component 

11.8 Scale Component 

11.9 OtherGUI lbolkits 

Summary • Terminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 







11.1 Introduction 


In this chapter, we continue our study of GUIs. We discuss more advanced components and 
lay the groundwork for building complex GUIs. 

We discuss Python megawidgets (Pmw) —a toolkit that provides high-level GUI com¬ 
ponents developed from smaller components provided by the Tkinter module. For 
example, a Pmw Scrol 1 edListBox component allows the user to select an item from a 
drop-down list. We continue our discussion with a look at the ScrolledText compo¬ 
nent that allows a user to manipulate multiple lines of text. We also discuss menus; Pmw 
class MenuBar creates a component that helps a user organize a menu. 

We also introduce more Tkinter classes. We use Tkinter class Menu to create 
popup menus—context-sensitive menus that typically appear when the user right clicks on 
components that have popup menus. Finally, we discuss the Tkinter Canvas compo¬ 
nent for displaying and manipulating text, images, lines and shapes. There are many GUI 
components and toolkits available to Python programmers, so we end this chapter with a 
description of several other toolkits. 


11.2 OverView ofPmw 

Python Megawidgets (Pmw) is a collection of useful GUI components built using module 
Tkinter. Each Pmw component combines one or more Tkinter components to create a 
useful, more complex component. Each Tkinter component can be referred to as a sub- 
component of the Pmw component. For example, the Pmw ComboBox component combines 
an Entry component and a Listbox component to create a more complex component that 
enables users to select an item from a Listbox and edit the selection in an Entry. 

Each subcomponent of a Pmw component can be configured independently—the 
appearance and functionality of the subcomponent can be modified. Pmw options have 
names of the form subcomponent_option , and the programmer configures a Pmw compo¬ 
nent by setting values for these options. Each component can be configured by passing 
option values in the constructor call either when the component is created or at a later time 
by passing option values in a call to method configure. For example, the following 
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statement creates a ScrolledListBox Pmw component and configures the Listbox 
subcomponent with a height of 3: 

Pmw.ScrolledListBox( self, listbox_height = ) 

The following line configures the height of the text component in an existing Pmw 

TextDialog component 

textdialog.configure( text_height = ) 

Although Pmw extends the functionality of the Tkinter module by providing addi- 
tional components, Pmw is not packaged with Python. To download the product, visit 
pmw.sourceforge.net. For installation instructions, visit the Deitel & Associates 
Web site at www. deitel. com. 

11.3 ScrolledListbox Component 

A list box (sometimes called a drop-down list ) provides a list of items from which the user 
can select. Tkinter class Listbox (a derived class of Widget) implements list boxes. 

In some cases, the number of items in a list prevents the list from being displayed 
entirely on the screen. In such cases, it is desirable to allow the user to scroll through the 
list. Scrolling can be implemented by configuring a Scrollbar and a Listbox to work 
together. However, Pmw offers a simpler option, the ScrolledListBoxmegawidget. 

Figure 11.1 uses the ScrolledListBox component to provide a list of four image 
filenames. When the user selects an image filename, the program displays the corre- 
sponding image in a Label. The screen captures show the ScrolledListBox list after 
a selection. 


1 

# Fig. 11.1: figll_01.py 


2 

# ScrolledListBox used to select image. 


3 

4 

from Tkinter import * 


5 

import Pmw 


6 

7 

class ImageSelection( Frame ): 


8 . List of available images and an area to display them""" 

9 

10 

def _init_( self, images ): 


11 .. Create list of Photolmages and Label to display them""" 

12 

13 

Frame._init_( self ) 


14 

Pmw.initialise() 


15 

self.pack( expand = , fili = 

) 

16 

self.master.title( 

) 

17 

18 

self.photos = [] 


19 

20 

# add Photolmage objects to list photos 

21 

for item in images: 


22 

self.photos.append( Photolmage( 

file = item ) ) 


Fig. 11.1 ScrolledListBox used to select an image. (Part 1 of 2.) 
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23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 


# create scrolled list box with vertical scrollbar 

self.listBox = Pmw.ScrolledListBox( self, items = images, 
listbox_height = , vscrollmode = , 

selectioncommand = self.switchlmage ) 
self.listBox.pack( side = , expand = , fili = 

padx = , pady = ) 

self.display = Label ( self, image = self.photos[ ] ) 
self.display.pack( padx = , pady = ) 

def switchlmage( self ): 


# get tuple containing index of selected list item 

chosenPicture = self.listBox.curselection () 

# configure label to display selected image 

if chosenPicture: 

choice = int( chosenPicture[ ] ) 

self.display.config( image = self.photos[ choice ] ) 


def main(): 

images = [ , , 

t 

ImageSelection ( images ).mainloop() 

if _ name_ == : 

main() 


1 






JSJxJ 


bugl.gif 


bug2.gif 

_ 

Hravelbuq.gif 

Ibuaanim.aif 

zi 






Fig. 11.1 ScrolledListBox used to select an image. (Part 2 of 2.) 


Line 5 imports module Pmw. In line 14, function Pmw. initialise initializes Pmw. 
The call to function initialise enables the program to access the full functionality of 
the Pmw module. 



Testing and Debugging Tip 11.1 

A program that uses module Pmwbut does not invoke Pmw. initialise is not able to ac¬ 
cess the full functionality of module Pmw. 








Method main (lines 45-48) creates a list of image filenames, images, that the pro¬ 
gram passes to the constructor method of class ImageSelection (lines 7-43). Lines 
21-22 create a list of Photolmage instances from the filenames in images. Lines 25- 
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27 create a new ScrolledListBox component called listBox. The items option 
contains the list of items to be displayed in listBox. When the user selectes an entry in 
listBox with the left-mouse button, the method assigned to selectioncommand 
(switchlmage) executes. 

Note thatthe vscrollmode option for listBox is setto "static" (line 26). This 
setting ensures that the vertscrollbar subcomponent of the ScrolledListBox (a 
Tkinter Scrollbar) is always present. Other possible values are "dynamic" (which 
displays the vertscrollbar only if necessary) and "none" (which never displays the 
vertscrollbar). The default value is "dynamic". 

Line 31 creates a Label to display the selected image. By default, the label contains 
the image of the first item in the list. When the user selects an item in listBox, method 
switchlmage (lines 34—43) changes the image. The call to ScrolledListBox 
method curselection (line 38) returns a tuple that contains one string. This string cor- 
responds to the index of the user-selected listbox item. For example, if the user selects the 
bugl. gif image (the first image in the list), method curselection returns ("0 "). If 
the tuple is not empty, Tkinter method config changes the Label component’s 
image attribute to the user-selected image. The ScrolledListBox component also 
provides method getcurselection that returns a tuple of the currently selected values, 
rather than indices of those values. 

By default, the user can select only one option in a ScrolledListbox component. 
A multiple-selection list enables the user to select several items from a Scrolled¬ 
Listbox. A ScrolledListbox’s listbox_selectmode option determines how 
many items a user may select. Possible values are SINGLE, BROWSE (default), MUL¬ 
TIPLE and EXTENDED. Value SINGLE allows the userto select one item at a time. Value 
BROWSE is the same as SINGLE, except that the user also may move the selection by drag- 
ging the mouse, rather than simply clicking an item. Value MULTIPLE allows the user to 
select multiple options, by clicking on multiple values. Value EXTENDED is similar to 
BROWSE, except that dragging the mouse selects multiple values. To select a contiguous 
range of items in a multiple-selection list, select the first item then press the Sliift key while 
selecting the last item in the range. To select multiple, nonconsecutive items, press the Ctrl 
key while selecting each item. To deselect an item, hold the Ctrl key while clicking the item 
a second time. 

A multiple-selection list does not have a specific event associated with making mul¬ 
tiple selections. Normally, an external event generated by another GUI component (e.g., a 
Button) specifies when the multiple selections in a ScrolleListbox should be pro- 
cessed. We illustrate an example of an external event in the next section. 

Look-and-Feel Observation 11.1 

Often an external event determines when a program should process the selected items in a 
multiple-selection ScrolledListBox. 



11.4 ScrolledText Component 

Tkinter Text components provide areas for manipulating multiple lines of text. Pmw de- 
fines a ScrolledText component, which is a scrolled Tkinter Text component. 
Figure 11.2 contains two ScrolledText components—one displays text that the user can 
select and the other displays the text the user selected in the first ScrolledText compo- 

































pythonhtpl_l l.fm Page 393 Friday, December 14, 2001 2:03 PM 





Chapter 11 


Graphical User Interface Components: Part 2 393 


nent. Sometimes, no event types are bound for a ScrolledText. Instead, an external 
event, (i.e., an event generated by a different GUI component) indicates when to process the 
text in a ScrolledText component. For example, many graphical e-mail programs pro¬ 
vide a Send button to send the text of the message to the recipient. In this program, a button 
generates the external event that determines when the program copies the selected text in the 
left ScrolledText component into in the right ScrolledText component. 




1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 


# Fig. 11.2: figll_02.py 

# Copying selected text from one text area to another. 

from Tkinter import * 
import Pmw 

class CopyTextWindow( Frame ): 


def _ init_( self ): 


Frame._init_( self ) 

Pmw.initialise() 

self.pack( expand = , fili = ) 

self.master.title( ) 

# create scrolled text box with word wrap enabled 

self.texti = Pmw.ScrolledText( self, 

text_width = , text_height = , text_wrap = , 

hscrollmode = , vscrollmode = ) 

self.texti.pack( side = , expand = , fili = 

padx = , pady = ) 



self.copyButton = Button( self, text = , 

command = self.copyText ) 

self.copyButton.pack( side = , padx = , pady = ) 

# create uneditable scrolled text box 

self.text2 = Pmw.ScrolledText( self, text_state = 

text_width = , text_height = , text_wrap = , 

hscrollmode = , vscrollmode = ) 

self.text2.pack( side = , expand = , fili = 

padx = , pady = ) 

def copyText( self ): 


self.text2.settext( self.texti.get( 
def main(): 

CopyTextWindow().mainloop() 


if _ name 

main() 


) ) 








Fig. 11.2 Text copied from one component to another. (Part 1 of 2.) 
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Fig. 11.2 Text copied from one component to another. (Part 2 of 2.) 

Lines 19-23 create and pack the first ScrolledText component— texti —with a 
25-column and 12-row Text subcomponent. The ScrolledText component’s 
text_wrap option determines whether text lines that are too long to display in the com¬ 
ponent wrap. Value NONE (default) does not continue text on the next line and displays only 
the text that fits in the component’s width. Value CHAR splits the text across multiple lines 
at the character location where the text becomes too long for the component. Value WORD 
is similar to value CHAR, except that the component splits the text on word boundaries (i.e., 
whitespace characters such as tabs and spaces). This last value enables word-wrapping, a 
common feature in many text editors. 

Look-and-Feel Observation 11.2 

To provide automatic word-wrap functionality for a Text component, specify the 
text_wrap option as WORD rather than NONE. 

Lines 25-27 create and pack copyButton and bind callback method copyText. 
Lines 30-34 create and pack the second ScrolledText component, text2. Line 30 
sets text2’s text_state option to DISABLED, rendering the text area uneditable by 
disabling calls to insert and delete for the component. 

When the user clicks copyButton, method copyText (lines 36-39) executes. This 
method retrieves the user-entered text from texti by invoking the component’s method 
get. Method get takes two arguments that specify the range of text to retrieve from the 
component. Line 39 retrieves the textl’s selected text by specifying a range that starts at 
the beginning of the selection (SEL_FIRST) and stops at the end of the selection 
(SEL_LAST). Method settext deletes the current text in the component and inserts the 
text the method receives as an argument. In this case, method settext inserts text 
returned by method get into text2. If the user has not selected any text, the program 
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raises a TclError exception and displays the error in an error dialog. We discussed 
exceptions briefly in Chapter 7, Object-Based Programming. In Chapter 12, Exception 
Handling, we discuss in detail how to handle exceptions (e.g., to prevent the program from 
displaying the error dialog). 


11.5 MenuBar Component 


Menus are an integral part of GUIs because they contain a list of actions, which, when se- 
lected by users, are performed by the applications. Menus simplify the appearances of 
graphical user interfaces by not “cluttering” the GUI with extra components (buttons, links, 
etc.). Simple Tkinter GUIs create menus with Menu components. Module Pmw includes 
class MenuBar, which contains the methods necessary to manage a menu bar, a Container 
for menus. 



Look-and-Feel Observation 11.3 


Menus simplify GUIs by reducing the number of components the user views at one time. 


A menu item is a GUI component inside a menu that performs an action when selected 
by a user. Menu items can be of different forms. The command menu item initiates an 
action. When a user selects a command menu item, the application invokes the item’s call- 
back method. The checkbutton menu item can be toggled on or off. When a user selects 
a checkbutton menu item, a checkmark appears to the left of the menu item. A user can 
select multiple checkbuttons (i.e, they are not mutually exclusive). Selecting a checked 
checkbutton removes the checkmark. 

The radiobutton menu item is another menu item that can be toggled on or off. 
When multiple radiobutton menu items are grouped together, a user can select only one 
item from each radiobutton-menu-item group. After selecting a radiobutton menu 
item, a checkmark appears to the left of the menu item. When a user selects another 
radiobutton menu item from the same group, the application removes the checkmark 
from the previously selected menu item. Like radioButtons (discussed in Chapter 10, 
Graphical User Interface Components: Part 1), radiobutton menu items are grouped 
logically by a shared variable. 

The separator menu item is a horizontal line in a menu. The cascade menu item 
is a submenu (or cascade menu) that provides more menu items from which the user can 
select. 

Look-and-Feel Observation 11.4 

The separator menu item can be used to group related menu items. 



A menu bar contains menu items and submenus. When a menu is clicked, the menu 
expands to show its list of menu items and submenus. Clicking a menu item generates an 
event. Figure 11.3 provides menus and menu items that enable a user to change the prop- 
erties of a line of text. The program also introduces balloons (also called a tool-tips) that 
display decriptions of menus and menu items. When the user moves the mouse cursor over 
a menu or menu item with a balloon, the program displays a specifted help message. 

Line 20 creates myBalloon —a Pmw Balloon component. Lines 21-23 create and 
pack a MenuBar component choices. Option balloon speciftes a Balloon compo- 
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nent that is attached to the menubar. Lines 26-34 build the program’s menu bar. Method 
addmenu (line 26) adds anew menu to choices. The method’s first argument ("File") 
is the menu name. The second argument ("Exit") contains the text that appears in the 
menu’s balloon. When the user places the mouse cursor over the File menu, the program 
displays this text in a floating label next to the cursor. 
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# Fig. 11.3: figll_03.py 

# MenuBars with Balloons demonstration. 

from Tkinter import * 
import Pmw 
import sys 

class MenuBarDemo( Frame ): 


def _ init_( self ): 


Frame._init_( self ) 

Pmw.initialise() 
self.pack( expand = 
self.master.title( 
self.master.geometry( 

self.myBalloon = Pmw.Balloon( self ) 
self.choices = Pmw.MenuBar( self, 
balloon = self.myBalloon ) 
self.choices.pack( fili = ) 

# create File menu and items 

self.choices.addmenu( , ) 

self.choices.addmenuitem( , , 

command = self.closeDemo, label = ) 

# create Format menu and items 

self.choices.addmenu( , 

self.choices.addcascademenu( 
self.choices.addmenuitem( 
self.choices.addcascademenu( 

# add items to Format/Color menu 

colors = [ , , , ] 

self.selectedColor = StringVar() 
self.selectedColor.set( colors[ ] ) 

for item in colors: 

self.choices.addmenuitem( , 

label = item, command = self.changeColor, 
variable = self.selectedColor ) 


) 

) 

) 

) 


, fili = 






Fig. 11.3 MenuBars created with Balloons (Partlof 3.) 
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# add items to Format/Font menu 

fonts = [ , , ] 

self.selectedFont = StringVar() 
self.selectedFont.set ( fonts [ ] ) 

for item in fonts: 

self.choices.addmenuitem( , 

label = item, command = self.changeFont, 
variable = self.selectedFont ) 


# add a horizontal separator in Font menu 

self.choices.addmenuitem( , ) 


# associate checkbutton menu 

self.boldOn = BooleanVar() 
self.choices.addmenuitem( 
label = , command = 

variable = self.boldOn ) 


item with BooleanVar object 

r r 

self.changeFont, 


# associate checkbutton menu item with BooleanVar object 

self.italicOn = BooleanVar() 

self.choices.addmenuitem( , , 

label = , command = self.changeFont, 

variable = self.italicOn ) 


# create Canvas with text 

self.display = Canvas ( self, bg = ) 

self.display.pack( expand = , fili = 


) 



self.sampleText = self.display.create_text( 
text = , font = ) 


def changeColor ( self ) : 


self.display.itemconfig( self.sampleText, 
fili = self.selectedColor.get() ) 

def changeFont ( self ) : 


# get selected font and attach size 

newFont = self.selectedFont.get() + 

# determine which checkbutton menu items selected 

if self.boldOn.get(): 
newFont += 

if self.italicOn.get () : 
newFont += 

# configure sample text to be displayed in selected style 

self.display.itemconfig( self.sampleText, font = newFont ) 








Fig. 11.3 MenuBarscreated with Balloons. (Part 2 of 3.) 
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99 

100 def closeDemo( self ): 

101 
102 

103 sys.exit() 

104 

105 def main() : 

106 MenuBarDemo().mainloop() 

107 

108 if _ name_ == : 

109 main() 








Fig. 11.3 MenuBarscreated with Balloons. (Part 3 of 3.) 

Lines 27-28 invoke method addmenuitem to insert a conunand menu item in the 
File menu. This method requires two arguments—the name of the menu to which the item 
belongs and the menu item’s type. This example adds the Exit menu item to the File menu. 
The method’s keyword argument label specifies the menu item’s text. The keyword argu- 
ment command specifies the menu item’s callback. When the user selects menu item Exit 
from the File menu, callback method closeDemo (lines 100-103) exits the program. 

Line 31 adds menu Format to the choices menubar. Method addcascademenu 
(line 34) adds a submenu to an existing menu. The method requires two arguments—the 
name of the menu to which the submenu belongs and the submenu’ s text. When the user 
opens the Format menu and selects Color, the program displays the Color submenu. 
Lines 33-34 add a separator menu item and a Font submenu to menu Format. The 
separator menu item is a line dividing the Color and Font submenus. 

[-and-Feel Observation 11.5 

items appear in the order in which they are added. Be sure to add them in the correct 
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Look-and-Feel Observation 11.6 


Menus nortnally appear from left to right in the order that they are added. 


Line 37 defines the list of color choices for the sample text. Lines 38-39 create 
StringVar selectedColor and initialize it to the first element of the list of color 
choices. Lines 41 —44 add a radiobutton menu item to the Color submenu for each 
item in a list of colors. Note that each radiobutton menu item shares the same callback 
method (changeColor) and the same variable (selectedColor). When the user 
selects an item, selectedColor’s value changes to the item’s text value and method 
changeColor is invoked. Variable selectedColor is shared by the radiobutton 
menu items in the group. 

Lines 51-54 add a radiobutton menu item for each item in a list of fonts to the 
Format menu’s Font submenu. Each radiobutton menu item shares the same call¬ 
back method (changeFont) and the same variable (selectedFont). 

Line 57 adds a separator menu item to the "Font " submenu. Lines 60-69 then add 
"Bold" and "Italic" checkbutton menu items to the Font submenu. Lines 60 and 
66 create two BooleanVar variables to represent whether these menue items are checked 
or unchecked). These values are passed to method addmenuitem through its variable 
keyword parameter. Although both checkbutton menu items share the same callback 
method (changeFont), they each have a different BooleanVar variable. The menu 
items’ BooleanVar variables serve the same purpose as in Tkinter Checkbutton 
components. When the user selects the menu item, the BooleanVar’s value changes to 1. 
When the user deselects the menu item, the BooleanVar’ s value changes to 0. 

Lines 72-73 create and pack display —a Tkinter Canvas with a white back- 
ground on which a program can display text, lines and shapes. A Canvas displays a canvas 
item —an object, like a string or a shape, that is drawn on the Canvas component. Each 
Canvas has a method that corresponds to a canvas item. Each of these methods creates a 
canvas item and adds it to the Canvas. For example, method create_text (lines 75- 
76) creates a canvas text item. This method draws the text "Sample Text" onto dis¬ 
play in the font ("Times 48") specified by keyword parameter font. We discuss 
Canvas components in more detail in Section 11.7. 

When the user selects a Color menu item, method changeColor (lines 78-82) con¬ 
figures sampleText to be filled (colored) with the value of selectedColor. Method 
i temconfig configures items on Canvas. Lines 77-78 set the color of sampleText 
to the selected color by specifying option fili. 

When the user selects a radiobutton menu item in the Font submenu of the 
Format menu, method changeFont (lines 84—98) changes the font of sampleText. 
Line 98 retrieves the desired font name from selectedFont. Lines 91-95 determine 
whether any checkbutton menu items of the Font submenu are selected. If so, the pro¬ 
gram appends the specified style to the font name. Line 92 then updates the text with the 
specified font. 


11.6 Ropup Menus 

Many of today’s computer applications provide context-sensitive popup menus. Such 
menus can be created easily with Tkinter class Menu. These menus provide options that 
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are specific to the component for which the popup trigger event was generated. On most 
systems, the popup trigger event occurs when the user presses and releases the right mouse 
button. However, with Tkinter, a popup trigger event must be specified by binding a 
callback to the desired trigger for a component. 

Figure 11.4 creates a Menu that allows the user to select one of three colors as the 
background color of the Frame. When the user clicks the right mouse button on the 
Frame, the program displays a popup menu containing a list of colors. If the user selects 
one of the radiobutton menu items that represents a color, the program changes the 
background color of the Frame. 
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# Fig. 11.4: figll_04.py 

# Popup menu demonstration. 

from Tkinter import * 
class PopupMenuDemo( Frame ): 


def _init_( self ): 


Frame._init_( self ) 

self.pack( expand = , fili = ) 

self.master.title( ) 

self.master.geometry( ) 

# create and pack frame with initial white 

self.framel = Frame( self, bg = ) 

self.framei.pack( expand = , fili = 

# create menu without packing it 

self.menu = Menu( self.framel, tearoff = 

colors = [ , , , 

self.selectedColor = StringVar() 
self.selectedColor.set( colors[ ] ) 

for item in colors: 

self.menu.add_radiobutton( label = item, 
variable = self.selectedColor, 
command = self.changeBackgroundColor ) 

# popup menu on right-mouse click 

self.framei.bind( , self.popUpMenu ) 

def popUpMenu( self, event ): 


background 


self.menu.post( event.x_root, event.y_root ) 






Fig. 11.4 Popup menu implementation. (Partlof2.) 

































pythonhtpl_l l.fm Page 401 Friday, December 14, 2001 2:03 PM 






Chapter 11 


Graphical User Interface Components: Part 2 401 


41 def changeBackgroundColor( self ): 

42 .Change the Frame background color""" 

43 

self.framel.config( bg = self.selectedColor.get() ) 

45 

46 def main () : 

47 PopupMenuDemo () .mainloop() 

48 

49 if _ name _ == 

50 main() 








Fig. 11.4 Popup menu implementation. (Part 2 of 2.) 

The Frame constructor’s bg option is a string that specifies the Frame’ s background 
color. Lines 18-19 create and pack framel with a white background. Line 22 creates a 
Tkinter Menu component called menu. Note that Menu’s tearof f option is set to 0. 
This setting removes the dashed separator line that is, by default, the first entry in a Menu. 
Lines 28-31 add a radiobutton menu item to menu for each item in a list of colors. 
Each radiobutton menu item has the same callback method ( changeBackground¬ 
Color) and the same variable (selectedColor). 

Line 34 binds method popUpMenu to a right-mouse click (<Button-3>) for 
framel. When the user right-clicks in framel, the popUpMenu callback (lines 36-39) 
executes. Line 39 calls Menu method post, which displays a Menu at a given position. 
This method accepts two arguments that correspond to the position on the top-level com¬ 
ponent at which the menu is displayed. Event attributes x_root and y_root contain the 
coordinates of the mouse cursor when the event was triggered. 

When a user selects one of the radiobutton menu items, method changeBack¬ 
groundColor executes. This method (lines 41-44) calls the config method of 
framel, specifying the new bg to be the value of selectedColor (line 44). This 
method call changes f ramei ’s background color. 

11.7 Canvas Component 

Figure 11.3 used a Canvas to display formatted text. Canvas is a Tkinter component 
that displays text, images, lines and shapes. Canvas inherits from Widget. By default, a 
Canvas is blank. To display items on a Canvas, a program creates canvas items. New 
items are drawn on top of existing items unless otherwise specified. 
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Figure 11.5 uses the <Bl-Motion> event and a Canvas to create a simple drawing 
program. The user draws pictures by dragging the mouse cursor over a Canvas. 
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# Fig. 11.5: figll_05.py 

# Canvas paint program. 

from Tkinter import * 
class PaintBox( Frame ): 

def _init_( self ): 


Frame._init_( self ) 

self.pack( expand = , fili = ) 

self.master.title( 

self.master.geometry( ) 

self.message = Label( self, 

text = ) 

self.message.pack( side = ) 

# create Canvas component 

self.myCanvas = Canvas( self ) 

self.myCanvas.pack( expand = , fili 


) 


) 


# bind mouse dragging event to Canvas 

self.myCanvas.bind( , self.paint ) 


def paint( self, event ): 


xl, yl = ( event.x - ), ( event.y - ) 

x2, y2 = ( event.x + ), ( event.y + ) 

self.myCanvas.create_oval( xl, yl, x2, y2. 


fili = 


def main(): 

PaintBox () .mainloopO 


if _ name 

main() 



) 









Fig. 11.5 Canvas paint program. 
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Lines 17-19 create and pack a Label with user instructions. Lines 22-23 create and 
pack Canvas instance myCanvas. Line 26 binds the mouse-drag event (<B1- 
Motion>) for the canvas to method paint (lines 28-33). When the user moves the 
mouse while holding down the left button, method paint executes. This method draws an 
oval on the Canvas myCanvas. Canvas method create_oval creates an oval 
Canvas item with a radius of 4 and a fili color of "black" centered at the current mouse 
cursor position (line 33). 

11.8 Scale Component 

The Scale component enables the user to select from a range of integer values. Class 
Scale inherits from Widget. Figure 11.6 shows a horizontal Scale with numeric val¬ 
ues and a slider that allows the user to select a value. 

Scales have either a horizontal orientation or a vertical orientation. On a horizontal 
Scale, the minimum value is at the extreme left and the maximum value is at the extreme 
right of the Scale. On a vertical Scale, the minimum value is at the extreme top and the 
maximum value is at the extreme bottom of the Scale. 


Figure 11.7 enables the user to specify the size of a circle drawn on a Canvas by using 
a Scale component. The diameter of the circle is controlled with a horizontal Scale. The 
radius changes when the user interacts with the Scale. 



Fig. 11.6 Horizontal Scale. 


1 

# Fig. 11.7: figll_07.py 



2 

# Scale used to control the 

size of a 

circle. 

3 




4 

from Tkinter import * 



5 




6 

class ScaleDemo( Frame ): 



7 

"""Demonstrate Canvas and 



8 




9 

def init ( self ): 



10 



:ontrolled by a Scale""" 

11 




12 

Frame._init_( self ) 



13 

self.pack( expand = 

, fili = 

) 

14 

self.master.title( 


) 

15 

self.master.geometry( 


) 

16 




17 

# create Scale 



18 

self.control = Scale( 

self, from_ = , to = , 

19 

orient = 

, command 

= self.updateCircle ) 








Fig. 11.7 Scale used to controlthe size of a circle on a Canvas. (Part 1 of 2.) 
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self.control.pack ( side = , fili = ) 

self.control.set ( ) 

# create Canvas and draw circle 

self.display = Canvas ( self, bg = ) 

self.display.pack( expand = , fili = ) 

def updateCircle( self, scaleValue ): 


end = int( scaleValue ) + 
self.display.delete( 
self.display.create_oval( 
fili = , tags = 


def main(): 

ScaleDemo() .mainloopO 


if _ name 

main() 


) 


, end, end, 
) 



Fig. 11.7 Scale used to controlthe size ofa circle on a Canvas. (Part2of 2.) 

Lines 18-20 create and pack control, the Scale used to change the size of the 
circle. The constructor’s orient option (HORIZONTAL or VERTICAL) determines 
whether the new Scale instance has a horizontal or vertical orientation. Options from_ 
and to specify the Scale component’s minimum and maximum values, respectively. The 
option values in lines 18-19 create a horizontal Scale with a minimum value of 0 and a 
maximum value of 200. The Scale’s callback is method updateCircle, which exe- 
cutes when the user moves the slider to change the numerical value. Note that although 

nothing is drawn on display in_ init _, the circle appears on display when the 

program starts. This is because when the Scale is created, its callback method (update¬ 
Circle) is invoked. Line 21 sets control’s value to 10, so that when the program starts, 
a circle of diameter 10 appears on the screen. Lines 24-25 create and pack display, a 
Canvas with a white background. 

When the user drags the slider, method updateCircle (lines 27-33) executes. The 
callback accepts as an argument the current value of the scale, represented as a string. Line 30 
converts this value to an integer, adds 10 to it and Stores the value in variable end. 
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Canvas method delete (line 31) deletes the old circle before drawing a new one. 
Method delete accepts one argument—either an item handle or a tag. Item handles are 
integer values that identify a newly drawn item. A tag is a name that can be attached to a 
canvas item at creation. To attach a tag to a canvas item, pass a string value to the tags 
option of the item’s create method. 

Method create_oval (lines 32-33) draws an oval with coordinates (10, 10, end, 
end), specifying option fili to be "red" and option tags to be "circle". The coor¬ 
dinates specify points on the ovaFs bounding rectangle. Canvas method create_item 
allows the user to create the following items by substituting their names for item —arc, 
line, oval, rectangle, polygon, image, bitmap, text and window. 

11.9 Other G Ul Toolkite 

Many different GUI Toolkits for Python exist. PyGTK (www. daa. com. au/~ james/ 
pygtk) provides an object-oriented interface for the Gimp ToolKit (GTK) component set 
(www. gtk. org). GTK is an advanced component set used primarily under the X Win¬ 
dows system (a graphics system providing a common interface for displaying windowed 
graphics). PyGTK is a part of GTK+, a Python toolkit for creating graphical user interfaces. 

Another popular GUI toolkit is wxPython (www.wxpython.org) — a Python 
extension module that enables access to wxWindows, a GUI library written in C++. This 
toolkit currently supports Microsoft Windows and most of the Unix-like systems. Python 
module wxPython wraps around wxWindows, providing the interface to manipulate 
wxWindows classes and methods. 

PyOpenGL (pyopengl. sourcef orge . net) provides a Python interface to the 
OpenGL (www. opengl. org) library. OpenGL is one of the most widely used libraries 
designed for developing interactive two-dimensional and three-dimensional graphical 
applications. It is available under Microsoft Windows, MacOS and most Unix-like Sys¬ 
tems. PyOpenGL can be used with Tkinter, wxPython and other windowing libraries. 
Chapter 24, Multimedia, discusses module PyOpenGL. 

SUMMARY 

• The Pmw (Python Mega Widgets) toolkit provides high-level GUI components composed of 
Tkinter components. 

• Megawidgets can also be configured for a particular use. The appearance and functionality of the 
components and their subcomponents can be modified. 

• The components can be configured either during or after creation with method conf igure. 

• In general, subcomponent options are named subcomponent_option. 

• A list box provides a list of items from which the user can make a selection. List boxes are imple- 
mented with Tkinter class Listbox, which inherits from class Widget. 

• Often, it is desirable to allow the user to scroll up and down a list. Scrolling can be achieved by 
creating a Tkinter Scrollbar and a Listbox separately and configuring them properly. 
Conveniently, Pmw provides a megawidget called ScrolledListBox that serves this purpose. 

• Function Pmw. initialise initializes Pmw. This function call allows a list of top-level compo¬ 
nents to be maintained. This call also ensures that Pmw is notified after the destruction of a com¬ 
ponent. 

• The items option contains the list of items that will be displayed in a ScrolledListBox. 
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• The method specified as a value for option selectioncommand executes each time an entry in 

a ScrolledListBox is selected. 

• Setting the vscrollmode option for a ScrolledListBox to "static" ensures that the 
vertscrollbar subcomponent of the ScrolledListBox (a Tkinter Scrollbar) will 
always be present. Other possible values are "dynamic" (display the vertscrollbar only if 
necessary) and "none" (the vertscrollbar will never be displayed). The default value is 

"dynamic". 

• Method curselection returns a tuple of the indices of the currently selected items in a 

ScrolledListBox. 

• The ScrolledListBox component also supports a getcurselection method that returns 
a tuple of the currently selected values, rather than the values’ indices. 

• By default, the user can select only one option in a ScrolledListbox component. 

• A multiple-selection list enables the user to select many items from a ScrolledListbox. 

• A ScrolledListbox's listbox_selectmode option Controls how many items a user 
may select. Possible values are SINGLE. BROWSE (default), MULTIPLE and EXTENDED. Value 
SINGLE allows the user to select only one item in the ScrolledListbox at a time. Value 
BROWSE is the same as SINGLE, except that the user also may move the selection by dragging 
the mouse, rather than simply clicking an item. Value MULTIPLE allows the user to select multi¬ 
ple options, by clicking on multiple values. Value EXTENDED acts like BROWSE, except that when 
the user drags the mouse, the user selects multiple values. 

• A multiple-selection list does not have a specific event associated with making multiple selections. 
Normally, an external event generated by another GUI component specifies when the multiple se¬ 
lections in a ScrolledListbox should be processed. 

• Tkinter Text components provide an area for manipulating multiple lines of text. Pmw defines 
a ScrolledText component, which is a scrolled Tkinter Text. 

• Sometimes, no event types are bound for a ScrolledText. Instead, an external event indicates 
when the text in a ScrolledText should be processed. 

• The ScrolledText component’s wrap option Controls the appearance of text lines that are too 
long to display in the component. Value NONE (default) for wrap means that the component trun- 
cates the line and displays only the text that fits in the component. Value CHAR for wrap means 
that the text is broken up when it becomes too long; the remainder of the text is displayed on the 
next line. Value WORD for wrap is similar to value CHAR. except that the component breaks the 
text on word boundaries. This last value enables word-wrapping, a common feature in many pop¬ 
ular text editors. 

• Setting a text subcomponent’s state as DISABLED renders the text area uneditable by disabling 
calls to insert and delete for the component. 

• The ScrolledText components method get retrieves the user-entered text. Method get 
takes two arguments that specify the range of text to retrieve from the component. Constant 
SEL_FIRST specifies the beginning of the selection. Constant SEL_LAST specifies the end of 
the selection. 

• Method settext deletes the current text in the component and inserts the specified text. 

• Menus are an integral part of GUIs. Menus allow the user to perform actions without unnecessarily 
“cluttering” a graphical user interface with extra GUI components. 

• Simple Tkinter GUIs create menus with Menu components. However, Pmw supplies class 
MenuBar, which contains the methods necessary to manage a menu bar, a Container for menus. 

• A menu item is a GUI component inside a menu that causes an action to be performed when se¬ 
lected. Menu items can be of different forms. 
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• A command menu item initiates an action. When the user selects a command menu item, the 
item’s callback method is invoked. 

• A checkbutton menu item can be toggled on or off. When a checkbutton menu item is se- 
lected, a check appears to the left of the menu item. When the checkbutton menu item is se- 
lected again, the check to the left of the menu item is removed. 

• When multiple radiobutton menu items are assigned to the same variable, only one item in 
the group can be selected at a given time. When a radiobutton menu item is selected, a check 
appears to the left of the menu item. When another radiobutton menu item is selected, the 
check to the left of the previously selected menu item is removed. 

• A separator menu item is a horizontal line in a menu that groups menu items logically. 

• A Cascade menu item is a submenu. A submenu (or Cascade menu) provides more menu items 
from which the user can select. 

• When a menu is clicked, the menu expands to show its list of menu items and submenus. 

• Clicking a menu item generates an event. 

• A balloon (also called a tool-tip) displays helpful text for menus and menu items. When the user 
moves the mouse cursor over a menu or menu item with a balloon, the program displays a specified 
help message. 

• Option balloon specifies a Balloon component that is attached to the menu. 

• Method addmenu of Pmw class MenuBar adds a new menu. The method’s first argument con- 
tains the name of the menu; the second argument contains the text that appears in the menu's bal¬ 
loon. When the user places the mouse cursor over the menu, the program displays this text. 

• Method addmenuitem of Pmw class MenuBar adds a menu item to a menu. This method re¬ 
quires two arguments: the name of the menu to which the item belongs and the menu item’s type. 

• MenuBar method addmenuitenfs keyword argument label specifies the menu itenvs text. 
Keyword argument command specifies the itenTs callback. 

• Method addcascademenu of Pmw class MenuBar adds a submenu to an existing menu. The 
method requires two arguments: the name of the menu to which the submenu belongs and the sub¬ 
menu’s text. 

• Many of today’ s computer applications provide context-sensitive popup menus. These menus pro¬ 
vide options that are specific to the component for which the popup trigger event was generated. 

• Context menus be created easily with Tkinter class Menu (a subclass of Widget). A popup 
trigger event must be specified by binding a callback to the desired trigger for a component. 

• The Frame constructor’s bg option takes a string specifying the Frame's background color. 

• Setting a Menu’s tearof f option to 0 removes the dashed separator line that is, by default, the 
first entry in a Menu. 

• Menu method post displays a Menu at a given position. This method accepts two arguments that 
correspond to the position on the top-level component at which the menu is displayed. 

• The current mouse position is specified by the x_root and y_root attributes of the Event in- 
stance passed to an event handler. 

• Canvas is a Tkinter component that displays text, images, lines and shapes. Canvas inherits 
from Widget. 

• By default, a Canvas is blank. To display items on a Canvas, a program creates canvas items. 
New items are drawn on top of existing items unless otherwise specified. 

• Adding canvas items to a Canvas displays something on the Canvas. Each canvas item has a 
corresponding Canvas method that creates the item and adds it to the canvas. 
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• Method create_text of class Canvas creates a canvas text item. Canvas method 
create_oval creates an oval Canvas item. 

• Method itemconfig of class Canvas configures items on Canvas. 

• Specifying a value for option fili sets the color of a canvas item. 

• The Scale component enables the user to select from a range of integer values. Class Scale in- 
herits from Widget. Scales have either a horizontal orientation or a vertical orientation. For a 
horizontal Scale, the minimum value is at the extreme left and the maximum value is at the ex¬ 
treme right of the Scale. For a vertical Scale, the minimum value is at the extreme top and the 
maximum value is at the extreme bottom of the Scale. 

• The Scale constructor’s orient option (HORIZONTAL or VERTICAL) determines whether 
the new Scale instance has a horizontal or vertical orientation. Options f rom_ and to specify 
the Scale component’s minimum and maximum values. When the Scale is created, its callback 
method is invoked. 

• Item handles are integer values that identify a newly drawn item. 

• A tag is a name that can be attached to a canvas item when the item is created. 

• Canvas method delete deletes a canvas item. Method delete accepts one argument—either 
an item handle or a tag. 

• To attach a tag to a canvas item, pass a string value to the tags option of the item’s create method. 

• Canvas methods create_item allow the user to create the following items by substituting 
their names for item: arc, line, oval, rectangle, polygon, image, bitmap, text and window. 

• PyGTK provides an object-oriented interface for the GTK component set (www. gtk. org). GTK 
is an advanced component set used primarily under the X Windows system (a graphics system pro- 
viding a common interface for displaying windowed graphics). 

• wxPython is a Python extension module that enables access of wxWindows. wxWindows is a GUI 
library written in C++. It currently supports Microsoft Windows and most of the Unix-like systems. 

• PyOpenGL provides a Python interface to the OpenGL (www. opengl. org) library—one of the 
most widely used libraries designed for developing interactive two-dimensional and three-dimen- 
sional graphical applications. It is available under Microsoft Windows, MacOS and most Unix- 
like systems. PyOpenGL can be used with Tkinter, wxPython and other windowing libraries. 

TERMINOLOGY 

addcascademenu method of MenuBar 
addmenu method of MenuBar component 
addmenuitem method of MenuBar 

balloon 

balloon option of MenuBar 
bg option of Frame component 
BROWSE value of listbox_selectmode 
option of ScrolledListbox 
Canvas component 
Cascade menu 
Cascade menu item 
CHAR option of wrap option of 
ScrolledText 
checkbutton menu item 
command menu item 
command option of MenuBar 



conf igure method of Pmw 
create_oval method of Canvas 
curselection method of 
ScrolledListBox 

"none" option of vscrollmode option of 
ScrolledListBox 

"static" option of vscrollmode option of 
ScrolledListBox 

"dynamic" value of vscrollmode option of 
ScrolledListBox 

EXTENDED value of listbox_selectmode 
option of ScrolledListbox 
extemal event 
fili option of Canvas 
font option of Canvas 
f rom_ option of Scale 



































pythonhtpl_l l.fm Page 409 Friday, December 14, 2001 2:03 PM 






Chapter 11 


Graphical User Interface Components: Part 2 409 







get method of ScrolledText 
getcurselection method of 
ScrolledListBox 
horizontal Scale component 
HORIZONTAL value of orient option 
of Scale 
item handle 

itemconf ig method of Canvas 

items option of ScrolledListBox 

Listbox component 

menu 

menu bar 

Menu component 

menu item 

mnemonics 

multiple-selection list 

NONE value of wrap option of ScrolledText 

orient option of Scale 

Pmw. initialise function 

popup trigger event 

post method of Menu component 

radiobutton menu item 

Scale component 

Scrollbar component 

ScrolledListBox component 

ScrolledText component 


SEL_FIRST argument to method get 

of ScrolledText 
SEL_LAST argument to method get 
of ScrolledText 
listbox_selectmode option 
of ScrolledListbox 
separator menu item 
settext method of ScrolledText 
SINGLE value of listbox_selectmode 
option of ScrolledListbox 
tag 

tags option of create method of Canvas 

tearoff option of Menu 

Text component 

to option of Scale 

tool-tip 

traverseSpec option of MenuBar 
variable keyword argument for 
method addmenuitem 
vertical Scale component 
VERTICAL value of orient option of Scale 
vscrollmode option of ScrolledListBox 
WORD option of wrap option 
of ScrolledText 
word wrapping 

wrap option of ScrolledText component 


SELF-REVIEW EXERCISES 


11.1 Fili in the blanks in each of the following: 

a) Tkinter class_, which inherits from class_, implement list boxes. 

b) If the vscrollmode of a vertical ScrolledListBox is set to_, the scroll 

bar component will never be displayed. 

c) A_enables the user to select many items from a list box. 

d) Set text_wrap to_in a ScrolledText widget to enable word wrap. 

e) When the user selects a_menu item, its callback function is invoked. 

f) A_displays help text for menu items. 

g) Tkinter component_displays text, images, lines and shapes. 

h) The_component enables a user to select from a range of integer values. 

i) _are integer values identifying an item drawn on a Canvas. 

j) An_allows selection of a contiguous range of items in the list. 

11.2 State whether each of the following is true or false. If false, explain why. 

a) Tkinter cannot provide a scrollbar with a list. 

b) By default, the scrollbar component of a ScrolledListBox is always displayed. 

c) The Pmw component ScrolledText is a scrolled Tkinter Text. 

d) Tkinter Menu components contain the methods necessary to manage a menu bar. 

e) A Cascade menu is a submenu that provides more items from which the user can select. 

f) Method addmenuitem adds menus to a menu bar, which can contain menu items. 

g) Tkinter class Menu can create context-sensitive popup menus. 

h) The minimum and maximum value positions on a Scale can be specified by setting the 
f rom_ and to options. 
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i) A Scale must be horizontal with the maximum value at the extreme right and the min¬ 
imum value at the extreme left. 

j) A radiobutton menu item can be toggled on and off. 

ANSWERS TO SELF-REVIEW EXERCISES 

11.1 a) Listbox, Widget. b) "none" . c) multiple-selection list. d) WORD, c) command. f) bal- 
loon. g) Canvas. h) Scale. i) Item handles. j) EXTENDED Listbox. 

11.2 a) False. A Tkinter Scrollbar can be attached to a Listbox to create a scrollable list. 
b) False. By default, the scrollbar component of a ScrolledListBox is displayed only if it is nec- 
essary to navigate the list. c) True. d) False. Pmw class MenuBar contains the methods necessary to 
manage a menu bar. e) True. f) False. Method addmenu adds menus to a menu bar, which can con- 
tain menu items. g) True. h) True. i) False. A Scale may have either a horizontal or a vertical ori- 
entation. j) True. 

EXERCISES 

11.3 Modify Exercise 10.4. Allow the user to select a Fahrenheit temperature to be converted with 
a horizontal Scale. When the user interacts with the Scale, update the temperature conversion. 

11.4 Rewrite the program of Fig. 11.2. Create a multiple-selection list of colors. Allow the user to 
select one or more colors and copy them to a ScrolledText component. 

11.5 Write a program that allows the user to draw a rectangle by dragging the mouse on a Can¬ 
vas. The drawing should begin when the user holds the left-mouse button down. With this button 
held down, the user should be able to resize the rectangle. The drawing ends when the user releases 
the left button. When the user next clicks on the Canvas, the rectangle should be deleted. 

11.6 Modify Exercise 11.5. Allow the user to fili the rectangle with a color. Create a popup menu 
of possible colors. The popup menu should appear when the user presses the right-mouse button. 

11.7 Write a menu designer program. The program allows the user to enter menu information and 
generates code to create that menu based on the user input. The GUI allows the user to enter the nec¬ 
essary input and displays the menu names in a Pmw ScrolledListBox as they are added. The pro¬ 
gram displays the generated code when the user has finished adding information. The program can 
be written with two distinet parts. 

a) Class Menus creates a GUI that allows the user to enter a menu narne or a menu narne, 
menu item and callback function. The program should issue a waming with a dialog box if 
the user does not enter the specified information. The GUI provides two Entry compo¬ 
nents for the menu narne and the menu item and a Pmw ScrolledText component for 
the callback function. The program generates code based on the user input that the user 
could exeeute to create the menu. The GUI should have an Add button whose callback 
adds the user input to the generated menu code, a Ciear button whose callback resets the 
GUI and a Finish button that ends the program, displaying the generated menu code. 

b) Class MenusList creates a single-selection list of the added menus. As the user adds 
menus, the Pmw ScrolledListBox should be updated with the new information. 
When the user selects a menu in the list, the menu items in that list are displayed in a Pmw 
ScrolledText component. 

You may add extra error checking and special features. For instance, when the user selects a 
menu narne in the Pmw ScrolledListBox display the menu name in the Entry component for 
menu names. 

11.8 Modify Exercise 11.7 so that, as the user adds menus and menu items a sample menu displays 
and is updated with any new information. 
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Objectives 

• To understand exceptions and error handling. 

• To use the try statement to delimit code in which 
exceptions may occur. 

• To be able to raise exceptions. 

• To use except clauses to specify exception handlers. 

• To use the f inally clause to release resources. 

• To understand the Python exception class hierarchy. 

• To understand Python’s traceback mechanism. 

• To create programmer-defined exceptions. 

It is common sense to take a method and try it. Ifitfails, 
admit itfrankly and try another. But above ali, try something. 
Franklin Delano Roosevelt 
O! throw away the worser part ofit, 

And live the purer with the other half. 

William Shakespeare 

Ifthey’re running and they don ’t look where they’re going 
Ihave to come outfrom somewhere and catch them. 

Jerome David Salinger 

And oftentimes excusing ofafault 

Doth make thefault the worse by the excuse. 

William Shakespeare 
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O uti i ne 

12.1 

Introduction 

12.2 

Raising an Exception 

12.3 

Exception-Handling OverView 

12.4 

Example: DivideByZeroError 

12.5 

Python Exception Hierarchy 

12.6 

f inally Clause 

12.7 

Exception Objectsand Tracebacks 

12.8 

Programmer-Defined Exception Classes 

Summary • Terminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 







12.1 Introduction 

In this chapter, we introduce exception handling. An exception is an indication of a “special 
event” that occurs during a program’s execution. The name “exception” indicates that, al- 
though the event can occur, the event occurs infrequently. Often, the special event is an er¬ 
ror (e.g., dividing by zero or adding two incompatible types); sometimes, the special event 
is something else (e.g., the termination of a for loop). Exception handling enables pro- 
grammers to create applications that can handle (or resolve) exceptions. In many cases, 
handling an exception allows a program to continue executing as if no problems were en- 
countered. More severe problems may prevent a program from continuing normal execu¬ 
tion. In such cases, the program can notify the user of the problem, then terminate in a 
controlled manner. The features presented in this chapter enable programmers to write pro- 
grams that are ciear, robust and more fault tolerant. 

The style and details of exception handling in Python are based on the work of the cre- 
ators of the Modula-3 programming language. The exception-handling mechanism is sim- 
ilar to that used in C# and Java. 

We begin with an overview of exception-handling concepts, then demonstrate basic 
exception-handling techniques. The chapter then overviews the exception-handling class 
hierarchy. 

Programs typically request and release resources (such as files on disk) during program 
execution. Often, these resources are in limited supply or can be used only by one program 
at a time. We demonstrate a part of the exception-handling mechanism that enables a pro¬ 
gram to use a resource, then guarantee that the program releases the resource for use by 
other programs. 

The chapter continues with an explanation and example of traceback objects—the 
objects that Python creates when it encounters an exception. The chapter concludes with an 
example that shows programmers how to create and use their own exception classes. 

12.2 Raising an Exception 

Chapter 7, Classes and Data Abstraction, introduced the rad.se statement, to signal that a 
client had attempted to assign an invalid value to an object’s attribute. The raise state- 
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ment indicates that an exception occurred (e.g., a function could not complete successful- 
ly). This is called raising (or sometimes throwing ) an exception. 

The simplest form of raising an exception consists of the keyword raise, followed by 
the name of the exception to raise. Exception names identify classes; Python exceptions are 
objects of those classes. When a raise statement executes, Python creates an object of the 
specified exception class. The raise statement also may specify arguments that initialize 
the exception object. To do so, follow the exception class name with a comma (,) and the 
argument (or a tuple of arguments). Programs can use an exception object’s attributes to dis- 
cover more information about the exception that occurred. The raise statement has many 
forms. Section 12.7 discusses another form of raise that specifies no exception name. 



Testing and Debugging Tip 12.1 

The arguments used to initialize an exception object can be referenced in an exception han- 
dler to perforn an appropriate task. 



Testing and Debugging Tip 12.2 

An exception can be raised without passing arguments to initialize the exception object. In 
this case, knowledge that an exception ofthis type occurred normally provides sufficient in¬ 
formation for the handler to perform its task. 


Until now, we have seen only how a raise statement causes a program to terminate 
and print an error message. This chapter demonstrates how a program detects that an excep¬ 
tion occurred (called catching an exception), then, based on that exception, takes appro¬ 
priate action (called handling the exception). Catching and handling exceptions enables a 
program to know when an error has occurred, then to take actions to minimize the conse- 
quences of that error. 


12.3 Exception-Handling OverView 

The logic of a program frequently tests conditions that determine how program execution 
proceeds. Consider the following pseudocode: 

Perform a task 

Ifthe preceding task did not execute correctly 
Perform error processing 

Perform next task 

Ifthe preceding task did not execute correctly 
Perform error processing 

This pseudocode begins by performing a task, then tests a condition to determine whether 
that task executed correctly. If not, error processing occurs. Otherwise, the pseudocode 
continues with the next task. Although this form of error handling may work, intermixing 
the logic of the program with the error-handling logic can make the program difficult to 
read, modify, maintain and debug—especially in large applications. In fact, if many of the 
potential problems occur infrequently, intermixing program logic and error handling can 
degrade the performance of the program, because the program must test extra conditions to 
determine whether the next task can be performed. 
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Exception handling enables programmers to remove error-handling code from the “main 
line” of the program’s execution. This improves program clarity and enhances modifiability. 
Programmers can decide to handle whatever exceptions they choose—all types of exceptions, 
ali exceptions of a certain type or all exceptions of a related type. Such flexibility reduces the 
likelihood that errors will be overlooked, thereby increasing aprogram’s robustness. 



Testing and Debugging Tip 12.3 

Exception handling helps improve a program ’sfault tolerance. When it is easy to write error - 
Processing code, programmers are more likely to use it. 


With programming languages that do not support exception handling, programmers 
often delay writing error-processing code and sometimes simply forget to include it. This 
results in less robust Software products. Python enables the programmer to deal with excep¬ 
tion handling easily from the inception of a project. Stili, the programmer must put consid- 
erable effort into incorporating an exception-handling strategy into Software projects. 



Incorporate your exception-handling strategy into a system from the inception of the design 
process. Adding effective exception handling after a system has been implemented is dijficult. 







In the past, programmers used many techniques to implement error-processing code. Excep¬ 
tion handling provides a single, uniform technique for processing errors. This enables pro¬ 
grammers working on large projects to understand each other’s error-processing code. 


The exception-handling mechanism also is useful for processing problems that occur 
when a program interacts with reusable Software elements, such as functions, classes and 
modules. Rather than internally handling problems that occur, such Software elements use 
exceptions to notify client code when problems occur. This enables programmers to imple¬ 
ment error handling that is appropriate to each application. 



Common Programming Error 12.1 


Aborting a program component could leave a resource—such as a file or a network connec- 
tion—in a state in which other programs are not able to acquire the resource. This is known 
as a “resource leak. ” 



Performance Tip 12.1 

When no exceptions occur, exception-handling code incurs little or no performance penal- 
ties. Thus, programs that implement exception handling operate more ejficiently than pro¬ 
grams that perform error handling throughout the program logic. 



Complex applicatioris normally consist ofpredefmed Software components (such as those de- 
fined in the Python Standard library) and components specific to the application that use the 
predefmed components. When a predefined component encounters a problem, that compo¬ 
nent needs a mechanism to communicate the problem to the application-specific compo¬ 
nent—the predefined component cannot know in advance how each application will process 
a problem that occurs. Exception handling simplifies combining Software components and 
having them work together ejfectively by enabling predefined components to communicate 
problems that occur to application-specific components, which can then process the prob¬ 
lems in an application-specific manner. 
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Although it is possible to do so, exceptions often are not used explicitlyfor conventionalflow 
ofcontrol. It is more dijficult to keep track the of consequently larger number of exception 
cases, which makes programs dijficult to read and maintain. 


Exception handling is geared to situations in which the code that detects an error is 
unable to handle it. Such code raises or throws an exception. There is no guarantee that 
there will be an exception handler —code that executes when the program detects an excep¬ 
tion—to process that kind of exception. If there is, the exception will be caught (detected) 
and handled. The resuit of an uncaught exception depends on whether the program is a GUI 
program or a console (non-GUI) program and on whether the program is running in inter- 
active mode. In a non-GUI program, an uncaught exception simply causes the program to 
print an error message and terminate. When a GUI program detects an uncaught exception, 
the program displays the error message (either in the console or in a dialog box, depending 
on the GUI package) and the program continues execution. Although a GUI program con¬ 
tinues execution after an uncaught exception, the program may fail to behave as expected, 
because of the error that caused the exception. When a program running in interactive mode 
detects an uncaught exception, the program displays an error message, terminates execu¬ 
tion and displays the interactive Python prompt. 

Python uses try statements to enable exception handling. The try statement 
encloses other statements that potentially cause exceptions. A try statement begins with 
keyword try, followed by a colon (:), followed by a suite of code in which exceptions 
may occur. The try statement may specify one or more except clauses that immediately 
follow the try suite. Each except clause specifies zero or more exception class names 
that represent the type(s) of exceptions that the except clause can handle. An except 
clause (also called an except handler ) also may specify an identifier that the program can 
use to reference the exception object that was caught. The handler can use the identifier to 
obtain information about the exception from the exception object. An except clause that 
specifies no exception type is called an empty except clause. Such a clause catches all 
exception types. After the last except clause, an optional else clause contains code that 
executes if the code in the try suite raised no exceptions. If a try statement specifies no 
except clauses, the statement must contain a f inally clause, which always executes, 
regardless of whether an exception occurs. We discuss each possible combination of 
clauses over the next several sections. 



Common Programming Error 12.2 


It is a syntax error to write a try statement that contains except and f inally clauses. 
The only acceptableforms are try/except. try/except/else and try/finally. 


When code in a program causes an exception, or when the Python interpreter detects a 
problem, the code or the interpreter raises (or throws) an exception. Some programmers 
refer to the point in the program at which an exception occurs as the throw point —an 
important location for debugging purposes (as we demonstrate in Section 12.7). Exceptions 
are objects of classes that inherit from class Exception. 1 If an exception occurs in a try 


1. Python exceptions also may be strings, to support programs that require earlier versions of the Py¬ 
thon interpreter. For newer Python versions (greater than 1.5.2), the class-based exception-han- 
dling technique is preferred. 
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suite, the try suite expires (i.e., terminates immediately), and program control transfers to 
the first except handler (if there is one) following the try suite. Next, the interpreter 
searches for the first except handler that can process the type of exception that occurred. 
The interpreter locates the matching except by comparing the raised exception’s type to 
each except’s exception type(s) until the interpreter finds a match. A match occurs if the 
types are identical or if the raised exception’s type is a derived class of the handler’s excep¬ 
tion type. If no exceptions occur in a try suite, the interpreter ignores the exception han- 
dlers for the try statement and executes the try statement’s else clause (if the statement 
specifies an else clause). If no exceptions occur, or if one of the except clauses success- 
fully handles the exception, program execution resumes with the next statement after the 
try statement. If an exception occurs in a statement that is not in a try suite and that state¬ 
ment is in a function, the function containing that statement terminates immediately and the 
interpreter attempts to locate an enclosing try statement in a calling code—a process 
called stack unwinding (discussed in Section 12.7). 

Python is said to use the termination model of exception handling, because the try 
suite that raises an exception expires immediately when that exception occurs. 2 




12.4 Example: DivideByZeroError 

Let us consider a simple exception-handling example. The program in Fig. 12.1 uses try, 
except and else to detect and handle exceptions. The program prompts the user to enter 
two numbers that represent the numerator and denominator of a division. After the user en- 
ters the two numbers, the program calls function f loat on each user-entered string, to 
convert the user inputs to floating-point values. The program then attempts to divide the 
first value by the second value. If the user types 0 in response to the request for a denomi¬ 
nator, an exception occurs when the program attempts to divide by zero. Also, if the user 
types a value that is not a number in response to either prompt, the program displays a mes- 
sage requesting that the user enter two numbers. 

Before we discuss the program details, consider the sample outputs Fig. 12.1. The first 
shows a successful calculation in which the user inputs the numerator 100 and the denom¬ 
inator 7. The output shows the resuit of the division. In the second output, the user enters 
the string "hello" at the second prompt. When the user presses Enter after typing the 
string, the program displays a message, indicating that the user must enter numbers. This 
occurs because f loat cannot convert a string argument to a floating-point value, so the 
function raises a ValueError exception. The program catches the exception and displays 
an appropriate message. The last output shows the resuit after an attempt to divide by zero. 
The Python interpreter itself tests for division by zero and raises a Zero- 
Di vis i onError exception if the denominator is zero. The program catches the excep¬ 
tion and displays a message, indicating an attempt to divide by zero. 

Let us consider the user interactions and flow of control that yield the results shown in 
the sample input/output dialogs. The user inputs values that represent the numerator and 


2. Some languages use the resumption model of exception handling in which, after handling the ex¬ 
ception, control retums to the point at which the exception was raised and execution resumes from 
that point. 
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1 # Fig. 12.1: figl2_01.py 

2 # Simple exception handling example. 

3 

4 numberl = raw_input( ) 

5 number2 = raw_input( ) 

6 

7 # attempt to convert and divide values 

8 try : 

9 numberl = float( numberl ) 

10 number2 = float( number2 ) 

11 resuit = numberl / number2 

12 

13 # float raises a ValueError exception 

14 except ValueError: 

15 print You must enter two numbers 

16 

17 # division by zero raises a ZeroDivisionError exception 

18 except ZeroDivisionError: 

19 print Attempted to divide by zero 

20 

21 # else clause's suite executes if try suite raises no exceptions 

22 else: 

23 print % ( numberl, number2, resuit ) 




denominator. The program then attempts to convert the user-entered values to floating-point 
values and to divide the numerator by the denominator. Lines 8-11 begin a try statement 
enclosing the code that may raise exceptions. Notice that the code in the try suite does not 
itself contain any raise statements and therefore may not appear to raise exceptions. In gen- 
eral, the statements in a try suite may call other code that possibly raises exceptions; or the 
statements in a try suite may raise exceptions if, for example, the code accesses an invalid 
sequence subscript, dictionary key or object attribute. In Fig. 12.1, the try suite makes two 
calls to function float (that may raise a ValueError exception) and performs one divi¬ 
sion operation (that may raise a ZeroDivisionError exception). 
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Place in a try suite a significant logical section ofprogram in which several statements can 
raise exceptions, rather than using a separate try statements for every statement that raises 
an exception. However, for proper exception-handling granularity, each try statement 
should enclose a section ofcode small enough that, when an exception occurs, the specific 
context is known and the except handlers can process the exception properly. If many 
statements in a try suite raise the same exception types, multiple try statements may be 
required to determine each exception 's context. 


Function f loat converts the user-entered values to floating-point values (lines 9-10). 
This function raises a ValueError exception if it cannot convert its string argument to a 
floating-point value. If lines 9-10 properly convert the values (i.e., no exceptions occur), 
then line 11 divides the numerator by the denominator and assigns the resuit to variable 
resuit. If the denominator is zero, line 11 causes the Python interpreter to raise a 
ZeroDivisionError exception. If line 11 does not cause an exception, then the try 
suite completes its execution. If no exceptions occur in the try suite, the program ignores 
the except handlers in lines 14-15 and 18-19 and continues program execution with the 
first statement of the else suite (lines 22-23). The else suite contains a single line that 
prints the resuit of division. After the else suite terminates, program execution continues 
with the first statement after the entire try statement (i.e., after line 23). In this example, 
the program contains no more statements, so program execution terminates. 


Common Programming Error 12.3 



It is a syntax error to place statements between a try suite and its first except handler, 
between except handlers, between the last except handler and the else clause, or be¬ 
tween the try suite and the finally clause. 



Testing and Debugging Tip 12.4 


Although a try suite can contain any type of statement, generally a try suite should con- 
tain only statements that may raise exceptions. Place in an else suite could that does not 
raise exceptions and should execute only if no exceptions occur in the corresponding try 
suite. 


Immediately following the try suite are two except clauses (also called except 
handlers or exception handlers)—lines 14-15 define the exception handler for a Val¬ 
ueError exception and lines 18-19 define the exception handler for the ZeroDivi¬ 
sionError exception. Each except clause begins with keyword except followed by 
an exception name that specifies the type of exception handled by the except clause, fol¬ 
lowed by a colon (:). The exception-handling code appears in the body of the except 
clause (i.e., in the indented code suite). In general, when an exception occurs in a try suite, 
an except clause catches the exception and handles it. In Fig. 12.1, the first except 
clause specifies that it catches ValueError exceptions (raised by function f loat). The 
second except clause specifies that it catches ZeroDivisionError exceptions 
(raised by the interpreter). Only the matching except handler executes if an exception 
occurs. Both the exception handlers in this example display an error message. When pro¬ 
gram control reaches the last statement of an except handler’s suite, the interpreter con- 
siders the exception handled, and program control continues with the first statement after 
the entire try statement (the end of the program in this example). 
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Testing and Debugging Tip 12.5 

An except handler always should specify the clciss name(s) ofthe exception(s) to catch. An 
empty except handler should be used onlyfor a default catch-all case. 


In the second input/output dialog, the user input the string "hello" as the denomi¬ 
nator. When line 10 executes, float cannot convert this string value to a floating-point 
value, so float raises a ValueError exception to indicate that the function was unable 
to perform the conversion. When an exception occurs, the try suite expires (terminates) 
immediately. Next, the interpreter attempts to locate a matching except handler starting 
with the except at line 14. The interpreter compares the type of the raised exception 
(ValueError) with the type following keyword except (also ValueError). A match 
occurs, so that exception handler executes, and the interpreter ignores all other exception 
handlers following the corresponding try suite. If a match did not occur, the interpreter 
compares the type of the raised exception with the next except handler in sequence and 
repeats the process until a match is found. 



An except clause can specify more than one exception with a comma-separated sequence 
of exception names in parentheses, following keyword except. Ifan except clause spec- 
ifies more than one exception, the exceptions should be related in some way (e.g., the excep- 
tions all are caused by mathematical errors). Use a separate except clause for each group 
of related exceptions. 


In the third input/output dialog of Fig. 12.1, the user input 0 as the denominator. When 
line 11 executes, the interpreter raises a ZeroDivisionError exception to indicate an 
attempt to divide by zero. Once again, the try suite terminates immediately upon encoun- 
tering the exception and the interpreter attempts to locate a matching except handler, 
starting from the except handler at line 14. The interpreter compares the type of the raised 
exception (ZeroDivisionError) with the type following keyword except (Value¬ 
Error). In this case, there is no match, because ZeroDivisionError and Val¬ 
ueError are not the same exception types and ValueError is not a base class of 
ZeroDivisionError. So, the interpreter proceeds to line 18 and compares the type of 
the raised exception (ZeroDivisionError) with the type following keyword except 
(ZeroDivisionError). A match occurs, so exception handler executes. If there were 
additional except handlers, the interpreter would ignore them. 


12.5 Python Exception Hierarc hy 

This section overviews several of Python’s exception classes. All exceptions inherit from 
base class Exception and are defined in module exceptions. Python automatically 
places all exception names in the built-in namespace, so programs do not need to import 
the exceptions module to use exceptions. Python defines four primary classes that in¬ 
herit from Exception— SystemExit , Stoplteration , Warning and 
StandardError. Exception SystemExit, when raised and left uncaught, terminates 
program execution. If an interactive session encounters an uncaught SystemExit excep¬ 
tion, the interactive session terminates. Python uses exception Stoplteration (new in 
version 2.2) to determine when a for loop reaches the end of its sequence. Python uses 
Warning exceptions to indicate that certain elements of Python may change in the future. 
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For example, if a Python 2.2 program uses a variable named yield, Python raises a 
Warning exception, because future versions of Python, will reserve yield for use as a 
keyword. StandardError is the base class for all Python error exceptions (e.g., 
ValueError and ZeroDivisionError). 

Figure 12.2 contains the exception hierarchy for Python 2.2. For any version of 
Python, the programmer can obtain the exception hierarchy with the statements 


import exceptions 
print exceptions._doc. 


Many StandardError exceptions can be caught at runtime and handled, so the pro¬ 
gram can continue running. Such exceptions often can be avoided by coding properly. For 
example, if a program attempts to access an out-of-range sequence subscript, the interpreter 
raises an exception of type IndexError. Similarly, an AttributeError exception 
occurs when a program attempts to access a non-existent object attribute. 

One of the benefits of the exception class hierarchy is that an except handler can 
catch exceptions of a particular type or can use a base-class type to catch exceptions in a 
hierarchy of related exception types. For example, Section 12.3 discussed the empty 
except handler, which catches exceptions of all types. An except handler that specifies 
an exception of type Exception also can catch all exceptions (assuming the raised excep¬ 
tions inherit from class Exception), because Exception is the base class of all excep¬ 
tion classes. 

Using inheritance with exceptions enables an exception handler to catch related excep¬ 
tions with a concise notation. An exception handler certainly could catch each derived-class 
exception individually, but it is more concise to catch the base-class exception if the han¬ 
dling behavior is the same for all derived classes. Otherwise, catch each derived-class 
exception individually. 



Common Programming Error 12.4 


It is a syntax error to place an empty except clause before the last except clause follow- 
ing a particular try suite. 



Common Programming Error 12.5 


It is a logic error iftwo or more except clauses following a particular try suite specify the 
exact same exception type. Python executes thefirst except handler that matches a raised ex¬ 
ception and ignores any additional except handlers that catch the same exception type. 


Common Programming Error 12.6 



Placing an except handler that catches type Exception before other except handlers 
is a logic error, because all exceptions would be caught before other exception handlers 
could be reached. Thus, subsequent exception handlers are unreachable. 


Determining when Python and Standard and third-party components raise exceptions 
can be difficult—there is no way for a program to determine whether, for example, a func- 
tion may raise a particular exception. The language reference and Standard library docu- 
mentation 3 often specify cases in which exceptions are raised. For example, in Fig. 12.1, 


3. The library reference can be found at www. python . org/doc/current/lib/lib. html, 
and the language reference can be found at www.python.org/doc/current/ref/ 
ref. html. 












































pythonhtpl_12.fm Page 421 Friday, December 14, 2001 2:04 PM 






Chapter 12 


Exception Handling 421 


Python exc eptions 

Exception 

SystemExit 

Stoplteration 

StandardError 

Keyboardlnterrupt 

ImportError 

EnvironmentError 

IOError 

OSError 

WindowsError {Note: Defined on Windows platforms only) 

EOFError 

RuntimeError 

NotlmplementedError 

NameError 

UnboundLocalError 

AttributeError 

SyntaxError 


IndentationError 


TabError 





TypeError 

AssertionError 


LookupError 
IndexError 
KeyError 
ArithmeticError 
OverflowError 
ZeroDivisionError 
FloatingPointError 
ValueError 

UnicodeError 

ReferenceError 

SystemError 

MemoryError 

Warning 

UserWarning 
DeprecationWarning 
SyntaxWarning 
OverflowWarning 
RuntimeWarning 






Fig. 12.2 Python exception hierarchy. 

we demonstrated that Python raises a ZeroDivisionError exception when a program 
attempts to divide by zero. In the language reference, Section 5.6 discusses the division 
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operator and States that division by zero causes a ZeroDivisionError exception. 
A third-party component intended for distribution and use in Software development also 
should include documentation that indicates the exceptions raised by the component and 
why such exceptions occur. 



If a component raises exceptions, the component documentation should state that the com¬ 
ponent raises the exception. Statements that use the component should be placed in try 
suites, and those exceptions should be caught and handled. 


12.6 finally Clause 

Programs frequently request and release resources dynamically (i.e., at execution time). For 
example, a program that reads a file from disk first asks to open that file. If that request suc- 
ceeds, the program reads the contents of the file. Operating systems typically can prevent 
more than one program from manipulating a file at once. Therefore, when a program fin- 
ishes processing a file, the program normally closes the file (i.e., releases the resource). 
This enables other programs to use the file. Closing the file helps prevent a resource leak , 
in which the file resource is not available to other programs because a program using the 
file never closed it. Programs that obtain certain types of resources (such as files) typically 
should return those resources explicitly to the system to avoid resource leaks. 

In programming languages (e.g., C and C++) in which programmers are responsible 
for dynamic memory management, the most common type of resource leak is a memory 
leak. This happens when a program allocates (obtains) memory, but does not deallocate 
(release) the memory when it is no longer needed. In Python, normally this is not an issue, 
because the interpreter performs garbage collectiori of memory no longer needed by an 
executing program. However, other kinds of resource leaks (such as the unclosed files men- 
tioned previously) can occur in Python. 

Testing and Debugging Tip 12.6 

The interpreter does not eliminate memory leaks completely. The interpreter will not gar- 
bage-collect an object while references to that object exist. Thus, memory leaks can occur if 
programmers erroneously keep references to unwanted objects. 



Most resources that require explicit release have potential exceptions associated with 
processing those resources. For example, a program that processes a file might receive 
IOError exceptions during the processing. For this reason, file processing code normally 
appears in a try suite. Regardless of whether a program successfully processes a file, the 
program should close the file when the file is no longer needed. 

Suppose a program places all resource-request and resource-release code in a try 
suite. If no exceptions occur, the try suite executes normally and releases the resources. 
However, if an exception occurs, the try suite expires before the resource-release code can 
execute. We could duplicate all resource-release code in the except handlers, but this 
makes the code more difficult to modify and maintain. 

Python’s exception handling mechanism provides the finally clause, which is guar- 
anteed to execute if program control enters the corresponding try suite, regardless of 
whether that try suite executes successfully or an exception occurs. This guarantee makes 
the finally suite an ideal location to place resource-deallocation code for resources 
acquired and manipulated in the corresponding try suite. If the try suite executes suc- 
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cessfully, the f inally suite executes immediately after the try suite terminates. If an 
exception occurs in the try suite, the f inally suite executes immediately after the line 
that caused the exception. The exception is then processed by the next enclosing try state- 
ment (if there is one). 



Testing and Debugging Tip 12.7 

A f inally suite typically contains code to release resources acquired in the corresponding 
try suite, making the f inally suite an effective way to eliminate resource leaks. 



Testing and Debugging Tip 12.8 

The only reason a f inally suite will not execute if program control entered the corre¬ 
sponding try suite is ifthe application terminates before the f inally can execute. 



Performance Tip 12.2 

As a rule, resources should be released as soon as they are no longer needed in a program. 
This makes those resources available for reuse immediately and enables other programs to 
access those resources. 





Before raising an exception, the code that raises the exception should release any resources 
acquired in the code before the exception occurred. 


Figure 12.3 demonstrates that the finally clause always executes, regardless of 
whether an exception occurs in the corresponding try suite. The program consists of two 
functions to demonstrate finally—doNotRaiseException (lines 4-14) and rai- 
seExceptionDoNotCatch (lines 16-27). The main program calls these functions to 
demonstrate when finally clauses execute. 


1 # Fig. 12.3: figl2_03.py 

2 # Using finally clauses. 

3 

4 def doNotRaiseException(): 

5 

6 # try block does not raise any exceptions 

7 try: 

8 print "In doNotRaiseException" 

9 

10 # finally executes because corresponding try executed 

11 finally: 

12 print "Finally executed in doNotRaiseException" 

13 

14 print "End of doNotRaiseException" 

15 

16 def raiseExceptionDoNotCatch () : 

17 

18 # raise exception, but do not catch it 

19 try: 

20 print "In raiseExceptionDoNotCatch" 

21 raise Exception 

22 








Fig. 12.3 finally aIwaysexecutes (Part 1 of 2.) 
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23 # finally executes because corresponding try executed 

24 finally: 

25 print "Finally executed in raiseExceptionDoNotCatch" 

26 

27 print Will never reach this point 

28 

29 # main program 

30 

31 # Case 1: No exceptions occur in called function. 

32 print "Calling doNotRaiseException" 

33 doNotRaiseException() 

34 

35 # Case 2: Exception occurs, but is not handled in called function, 

36 # because no except clauses exist in raiseExceptionDoNotCatch 

37 print "\nCalling raiseExceptionDoNotCatch" 

38 

39 # call raiseExceptionDoNotCatch 

40 try: 

41 raiseExceptionDoNotCatch() 

42 

43 # catch exception from raiseExceptionDoNotCatch 

44 except Exception: 

45 print + \ 

46 "in main program. 


Calling doNotRaiseException 
In doNotRaiseException 

Finally executed in doNotRaiseException 
End of doNotRaiseException 

Calling raiseExceptionDoNotCatch 
In raiseExceptionDoNotCatch 

Finally executed in raiseExceptionDoNotCatch 

Caught exception from raiseExceptionDoNotCatch in main program. 


Fig. 12.3 finally a Iwaysexecutes (Part 2 of 2.) 


Line 33 of the main program calls function doNotRaiseException (lines 4-14)— 
a function that contains a try/f inally form. The try suite (line 8) outputs a message. The 
try suite does not raise any exceptions, so program control reaches the end of the suite. Next, 
the finally clause’s suite (line 12) executes and outputs a message. At this point, program 
control continues with the first statement after the finally suite, because no exception was 
raised. This statement (line 14) outputs a message indicating that the end of the function has 
been reached. Then, program control returns to the main program. 


Common Programming Error 12.7 



It is a syntax error to write a try statement that does not contain either a finally clause 
or one or more except clauses. Ifa try statement does not have any except clauses, it 
musthavea finally clause. Ifa try statement does not have a finally clause, itmust 
have one or more except clauses. 






Lines 40-41 of the main program begin a try statement that invokes function raise¬ 
ExceptionDoNotCatch (lines 16-27). The try statement enables the main program to 
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catch any exceptions raised by raiseExceptionDoNotCatch. In raiseExcep- 
tionDoNotCatch, the try suite (lines 20-21) begins by outputting a message. Next, the 
try suite raises an Exception (line 21) and the try suite expires immediately. This try 
statement does not specify any except clauses; therefore, the exception is not caught in 
function raiseExceptionDoNotCatch. Normal program control cannot continue until 
that exception is caught and processed. Thus, the interpreter will terminate raise¬ 
ExceptionDoNotCatch and program control will return to the main program. Before 
control returns to the main program, however, the f inally clause’s suite (line 25) executes 
and outputs a message. At this point, program control returns to the main program—any state- 
ments appearing afterthe f inally suite (e.g., line 27) do not execute. In the main program, 
the except handler in lines 44— 4 6 catches the exception and displays a message indicating 
that the exception was caught in the main program. 


Common Programming Error 12.8 



Raising an exception in a f inally suite is a potentially dangerous operation. If an un- 
caught exception is awaiting processing when the f inally suite executes and the f inal¬ 
ly suite raises a new exception that the suite does not catch, the first exception is lost, and 
the new exception ispassed to the next enclosing try statement. 



Testing and Debugging Tip 12.9 

In a f inally suite, always enclose in a try statement code that may raise an exception. 
This prevents losing uncaught exceptions that occur before the f inally suite executes. 



Software Engineering Observation 12.9 

Ifa try statement specifies a f inally clause, the f inally clause's suite executes even 
ifthe try suite is terminated by a return statement. Then, the return to the calling code 
occurs. 


Note that the point at which program control continues after the f inally clause exe¬ 
cutes depends on the exception-handling state. If the try suite successfully completes, the 
f inally suite executes and control continues with the next statement after the f inally 
suite. If the try suite raises an exception, the f inally suite executes then program con¬ 
trol continues in the next enclosing try statement. The enclosing try may be in the 
calling function or one of its callers. It also is possible to nest a try/except form in a 
try suite, in which case the outer try statement’s exception handlers would process any 
exceptions the were not caught in the inner try statement. 



12.7 Exception Objectsand Tracebacks 

As we discussed in Section 12.5, exception data types—which derive from class Excep¬ 
tion —can be created with zero or more arguments. These arguments frequently are used 
to formulate error messages for a raised exception. When Python creates an exception ob- 
ject in response to a raise statement, Python places any arguments from the raise state¬ 
ment in the exception object’s args attribute. 

When an exception occurs, Python “remembers” the exception that has been raised and 
the current state of the program. Python also maintains traceback objects that contain 
information about the function call stack from the time the exception occurred. Recall that 
exceptions can be raised in a deeply nested series of function calls. As the program calls 
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each function, Python inserts the function name at the beginning of th efunction call stack. 
When an exception is raised, Python begins searching for an exception handler. If no excep¬ 
tion handler exists in the current function, the current function terminates execution, and 
Python searches the current function’s calling function, and so on, until either an exception 
handler is found or Python reaches the main program. This process of searching for an 
appropriate exception handler is called stack unwinding. Just as the interpreter maintains 
information about functions that are placed on the stack, the interpreter maintains informa- 
tion about functions that have been unwound from the stack. 



Testing and Debugging Tip 12.10 

A traceback shows the complete function call stack from the time at which an exception oc- 
curred. This lets the programmer view the series of function calls that led to the exception. 
Information in the traceback includes names of unwound functions, names of the files in 
which the functions are defined and line numbers that indicate where the program encoun- 
tered an error. The Iasi line number in the traceback indicates the throw point (i.e., the loca- 
tion where the original exception was raised). Previous line numbers indicate the locations 
from which each fimction in the traceback was called. 


Our next example (Fig. 12.4) demonstrates exception object’s args attribute and 
exception object string representation. The example also demonstrates how to access tra¬ 
ceback objects to print information about stack unwinding. As we discuss this example, 
we keep track of the functions on the call stack so we can discuss the traceback object 
and the stack-unwinding mechanism. 


1 # Fig. 12.4: figl2_04.py 

2 # Demonstrating exception arguments and stack unwinding. 

3 

4 import traceback 

5 

6 def functioni(): 

function2() 

8 

9 def function2() : 

10 function3() 

11 

12 def function3() : 

13 

14 # raise exception, catch exception, reraise exception 

15 try : 

16 raise Exception, 

17 except Exception: 

18 print ght exception in function3. Reraising... 

19 raise # reraises most recent exception 

20 

21 # call functioni, any Exception it generates will be 

22 # caught by the except clause that follows 

23 try: 

24 functioni() 

25 








Fig. 12.4 Exception argumentsand stack unwinding. (Part lof 2.) 
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26 # output exception arguments, string representation of exception, 

27 # and the traceback 

28 except Exception, exception: 

29 print "Exception caught in main program." 

30 print , exception.args 

31 print , exception 

32 print \nTraceback 

33 traceback.print_exc() 


Caught exception in 

function3. Reraising.... 

Exception caught in 

main program. 

Exception arguments: 

('An exception has occurred',) 

Exception message: An exception has occurred 

Traceback: 


Traceback (most recent call last): 

File "figl2_04.py" 

, line 24, in ? 

functioni() 


File "figl2_04.py" 

, line 7, in functioni 

function2() 


File "figl2_04.py" 

, line 10, in function2 

function3() 


File "figl2_04.py" 

, line 16, in function3 

raise Exception, 

"An exception has occurred" 

Exception: An exception has occurred 


Fig. 12.4 Exception argumentsand stack unwinding. (Part 2 of 2.) 



The interpreter begins executing the program with line 1. This is technically the first 
line in the main program. The main program is the first entry in the function call stack, 
because it is the entity that invokes all other functions. Line 24 of the try suite in the main 
program invokes functioni (defined in lines 6-7), which becomes the second entry on 
the stack. If functioni raises an exception, the except handler in lines 28-33 catch 
the exception and output information about the exception that occurred. Line 7 of 
functioni invokes function2 (defined in lines 9-10), which becomes the third entry 
on the stack. Then, line 10 of function2 invokes function3 (defined in lines 12-19) 
which becomes the fourth entry on the stack. 

At this point, the call stack for the program is 

function3 (top) 

function2 

functioni 

Main Program 

with the last function called (function3) at the top and the main program at the bottom. 
Line 16 in function3 raises an Exception and passes the string "An exception 
has occurred" as an argument. In response to the raise statement, Python creates an 
Exception object, with the specified argument. The except clause in lines 17-19 
catches the exception and first prints a message. Line 19 uses an empty raise statement 
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to reraise the exception. Usually, reraising an exception indicates that the except handler 
performed partial processing of the exception and is now passing the exception back to the 
caller (in this case function2) for further processing. In this example, the function3 
demonstrates that keyword raise. with no specified exception name, reraises the most re- 
cently raised exception. 



Ifafunction is capable of handling a given type of exception, then let thatfunction handle it, 
rather than passing the exception to another region of the program. 


Next, function3 terminates because the reraised exception is not caught in the 
function body. Thus, control will return to the statement that invoked function3 in the 
prior function in the call stack(function2). This removes or unwinds function3 from 
the function call stack (thus, terminating the function) and Python maintains information 
about the function call in a traceback object. 

When control returns to line 10 in function2, the interpreter ascertains that line 10 
is not in a try suite. Therefore, the exception cannot be caught in function2, and 
function2 terminates. This unwinds function2 from the function call stack, creates 
another traceback object (to represent the current level of unwinding) and returns con¬ 
trol to line 7 in functioni. Here again, line 7 is not in a try suite, so the exception 
cannot be caught in functioni. The function terminates and unwinds from the call stack, 
creating another traceback object and returning control to line 24 in the main program, 
which is in a try suite. The try suite in the main program expires and the except han¬ 
dler in lines (28-33) catches the exception. 

Notice that the except clause in line 28 differs from the except clauses presented 
thus far. When Python encounters an except clause in which except is followed by an 
exception type (or tuple of exception types), a comma, and an identifier, Python binds the 
identifier to the matching exception object. Now, the except handler can use the identi¬ 
fier to obtain information about the specific exception that occurred. The except suite in 
lines 29-33 prints the exception object’s args attribute (line 30). Then, the handler prints 
the string representation of the exception. Python’s string representation of an exception 
object depends on the value of its args attribute. If the args attribute is an empty tuple, 
Python represents the exception as the empty string. If an exception objects’s args tuple 
contains only one value, Python’s represents the exception as the string representation of 
that value. If an exception object’s args tuple contains multiple items, Python represents 
the exception as the string representation of the args tuple. In this example, the exception 
object’s arg attribute contains only one value, so Python represents the exception as that 
value (i.e., the string "An exception has occurred"). 

Line 33 of the except handler calls function traceback. print_exc to print the 
traceback. Module traceback contains many functions for manipulating the trace¬ 
back objects that Python creates during stack unwinding. Recall that stack unwinding con¬ 
tinues until either an except handler catches the exception or the program terminates. 
Function print_exc, when called with no arguments, prints ali the traceback objects 
accumulated thus far in the stack-unwinding process. This output is identical to the output 
Python produces when the interpreter encounters an uncaught exception. Let us examine 
the output from function print_exc. The first line 


Traceback (most recent call last) 
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is the Standard traceback line that Python prints when an error occurs. This line indicates 
that the most recent call (i.e., the call at the top of the call stack when the exception oc- 
curred) appears last in the traceback output. The next two lines in the traceback output con- 
tain information about the first call on the function call stack (i.e., the call to functioni 
from the main program). The information includes the file in which the call occurred 
(f igl2_04 . py), the line number of the file that called the function (24) and the calling 
entity from which the function was invoked (?, which corresponds to the main program). 
The subsequent pairs of lines in the traceback output each correspond to a call on the func¬ 
tion call stack. The second-to-last line contains the code that caused the exception (i.e., the 
code from line 16 in function3 that contains the raise statement). This demonstrates 
the fact that the empty raise statement in line 19 simply reraises the exception from line 
16. The final line of the output contains a string representation of the exception type and its 
argument. Note that traceback output contains information about the call stack from the 
point at which the exception occurred to the point at which the exception is caught (or the 
point at which the program terminates, if the exception is not caught). 



Testing and Debugging Tip 12.11 

When reading a traceback, startfrom the end ofthe traceback and read the error message 
first. Then, read up the remainder of the traceback, looking for the first Une that indicates 
code that you wrote in yourprogram. Normally, this is the location that caused the exception. 


12.8 Ftogrammer-Defined Exception Classes 


In many cases, programmers can use existing exception classes from the Python hierarchy 
to indicate exceptions that occur in their programs. However, in some cases, programmers 
may wish to create new exception types that are more specific to the problems that occur 
in their programs. Progrcimmer-defined exception classes should derive directly or indi- 
rectly from class Exception. 



Good Programming Practice 12.1 

Associating each type ofmalfimction with an appropriately named exception class improves 
program clarity. 



Good Programming Practice 12.2 

Before creating programmer-defined exception classes, investigate the existing exception 
classes in the Python hierarchy to discover whether an appropriate exception type already 
exists. 



Good Programming Practice 12.3 

Define new exception classes only if programmers need to catch and handle the new excep¬ 
tions dijferently from other existing exception types. 


Figure 12.5 demonstrates defining and using a programmer-defined exception class. 
Class NegativeNumberError (lines 6-8) is a programmer-defined exception class 
representing exceptions that occur when a program performs an illegal operation on a neg¬ 
ative number, such as the square root of a negative number. 

Lines 6-8 define a programmer-defined exception class. The Python exception class 
hierarchy deftnes many categories of exceptions, and programmer-defined exceptions should 
extend an appropriate exception from one of these categories. NegativeNumberError 
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1 

# Fig. 12.5: figl2_05.py 



2 

# Demonstrating a programmer-defined exception class. 


3 




4 

5 

import math 



6 

class NegativeNumberError( ArithmeticError 

) : 


7 




8 

pass 



9 




10 

def squareRoot( number ): 



11 




12 




13 




14 

if number < : 



15 

raise NegativeNumberError, \ 



16 




17 




18 

return math.sqrt( number ) 



19 




20 

while : 



21 




22 

# get user-entered number and compute square root 


23 

try : 



24 

userValue = float ( raw_input( 


) ) 

25 

print squareRoot( userValue ) 



26 




27 

# float raises ValueError if input is not numerical 


28 

except ValueError: 



29 

print "The entered value is not a nui 



30 




31 

# squareRoot raises NegativeNumberError 

if number is 

negative 

32 

except NegativeNumberError, exception: 



33 

print exception 



34 




35 

# successful execution: terminate while 

loop 


36 

else : 



37 

break 



Please enter a number: hello 



The 

entered value is not a number 



Please enter a number: -900 



Square root of negative number not permitted 



Please enter a number: 12.345 



3.51354521815 




Fig. 12.5 Programmer-defined exception class. 







exceptions most likely occur during arithmetic, so it seems logical to derive class Negativ¬ 
eNumberError from class ArithmeticError. Creating simple, programmer-defined 
exceptions in Python is easy, because the new exception class inherits all its functionality 
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from the base-class exception. Therefore, the body of the class contains only the keyword 
pass —the keyword that indicates a suite or block performs no work. 

The remainder of the program (lines 10-37) demonstrates our programmer-defmed 
exception class. The program enables the user to input a numeric value, then invokes function 
squareRoot (lines 10-18) to calculate the square root of that value. For this purpose, 
squareRoot invokes function math. sqrt, which wants a nonnegative value as its argu- 
ment. If math. sqrt receives a negative value, the function raises a ValueError excep¬ 
tion with the argument "math domain error " . In this program, we essentially write our 
own square root function that uses a programmer-defined exception to prevent the user from 
calculating the square root of a negative number. If the numeric value received from the user 
is negative, function squareRoot raises a NegativeNumberError (lines 14—16). Oth- 
erwise, squareRoot invokes function math. sqrt to compute the square root. 

In the main program, a while loop (lines 20-37) continues executing until the user 
enters a nonnegative value. The try suite (lines 24—25) attempts to obtain a numerical 
value from the user and to pass that value to function squareRoot. When the user inputs 
a value and presses Enter , the program passes the user-entered value to function f loat. If 
the value is not a number, function float raises a ValueError exception, and the 
except handler in lines 28-29 prints an error message. Control then retums to the beginning 
of the while loop. If the user inputs a negative number, function squareRoot raises a 
NegativeNumberError. The except handler in lines 32-33 simply prints the exception 
object before control returns to the beginning of the while loop. If the user enters a valid, 
nonnegative number, line 25 prints the square root of the number before program control 
proceeds to the else clause in lines 36-37. The else suite contains only the keyword 
break, which terminates the while loop. 

In this chapter, we demonstrated how the exception-handling mechanism works and 
discussed how to make applications more robust by writing exception handlers to process 
potential problems. When developing new applications, it is important to investigate poten- 
tial exceptions raised by the functions your program invokes or by the interpreter, then 
implement appropriate exception-handling code to make those applications more robust. In 
Chapter 13, String Manipulation and Regular Expressions, we begin a discussing a series 
of techniques for developing substantial Software. These techniques, when combined with 
disciplined exception handling, enable Python programmers to create viable, valuable Soft¬ 
ware components. 

SUMMARY 

• An exception is an indication of a “special event” that occurs during a program’s execution. Often 
the special event is an error (e.g., dividing by zero or adding two incompatible types). Sometimes 
the special event is something else (e.g., the termination of a for loop). 

• Exception handling enables programmers to write ciear, robust, more fault-tolerant programs that 
can resolve (or handle) exceptions. 

• The style and details of exception handling in Python are based on the Modula-3 language. This 
exception-handling mechanism is similar to that used in C# and Java. 

• The raise statement executes to indicate that an exception has occurred. This is called raising 
(or sometimes throwing) an exception. 

• The simplest raise statement consists of the keyword raise, followed by the name of the ex¬ 
ception to be raised. 
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Exception names specify classes and Python exceptions are objects of those classes. When the 
raise statement executes, Python creates an object of the specified exception class. 

The raise statement may specify an argument or arguments that initialize the exception object. 
In this case, a comma follows the exception name, and the argument or a tuple of arguments fol- 
lows the comma. 


Exception handling enables the programmer to remove error-handling code from the “main line” 
of the program’s execution. This improves program clarity and enhances modifiability. 
Programmers can decide to handle whatever exceptions they choose—ali types of exceptions, all 
exceptions of a certain type or all exceptions of related types. 

The exception-handling mechanism is useful for processing problems that occur when a program 
interacts with reusable Software components. Rather than intemally handling problems that occur, 
such components use exceptions to notify client code of problems. This enables programmers to 
implement error handling that is appropriate to each application. 

Exception handling is geared to situations in which the code that detects an error is unable to han¬ 
dle it. Such code raises or throws an exception. 

Python uses try statements to enable exception handling. The try statement encloses statements 
that potentially cause exceptions. A try statement consists of keyword try. followed by a colon 
(:), followed by a suite of code in which exceptions may occur, followed by one or more clauses. 


Immediately following the try suite may be one or more except clauses (also called except 
handlers). Each except clause specifies zero or more exception names that represent the type(s) 
of exceptions the except clause can handle. 


The except clause also may specify an identifier for the exception that was raised, and the han- 
dler can use the exception object to obtain information about that exception. 


An except clause that specifies no exception type is an empty except clause, which catches 
all exception types. It is a syntax error to place an empty except clause before any other except 
clauses in a particular try statement. 


After the last except clause, an optional else clause contains code that executes if the code in 
the try suite raised no exceptions. 


A try suite can be followed by zero except clauses; in that case, it must be followed by a f i- 
nally clause. The code in the f inally suite always executes, regardless of whether an excep¬ 
tion occurs. 


Programmers sometimes refer to the point in the program at which an exception occurs as the 
throw point. 

Exceptions are objects of classes that inherit from class Exception. 

If an exception occurs in a try suite, the try suite expires and program control transfers to the 
first matching except handler (if there is one) following the try suite. A match occurs if the types 
are identical or if the raised exception’s type is a derived class of the handler’s exception type. 

If no exceptions occur in a try suite, the interpreter ignores the exception handlers for that try 
statement. 


If an exception occurs in a statement that is not in a try suite and that statement is in a function, 
the function containing that statement terminates immediately and the interpreter attempts to lo¬ 
cate an enclosing try statement in a calling function—a process called stack unwinding. 

Python is said to use the termination model of exception handling, because the try statement en¬ 
closing a raised exception expires immediately when that exception occurs. 

Function f loat raises a ValueError exception if the function cannot convert its argument val- 
ue to a floating-point value. 

































pythonhtpl_12.fm Page 433 Friday, December 14, 2001 2:04 PM 






Chapter 12 


Exception Handling 433 







The Python interpreter automatically tests for division by zero and raises a ZeroDivision- 
Error exception if the denominator is zero. 

As good programming practice, an except handler always should specify the name of the excep¬ 
tion to catch. An empty except handler should be used only for a default catch-all case. 

The preferred exception-handling mechanism is to allow objects of class Exception and its de- 
rived classes to be raised and caught. 

An except handler can catch exceptions of a particular type or can use a base-class type to catch 
exceptions in a hierarchy of related exception types. 


A third-party component intended for distribution and use in Software development also should 
include documentation that indicates which exceptions are raised by the component. 

Programs frequently request and release resources dynamically. Programs that obtain certain types 
of resources (such as files) sometimes must return those resources explicitly to the system to avoid 
resource leaks. Most resources that require explicit release have potential exceptions associated 
with processing those resources. 

The f inally clause that guaranteed to execute if program control enters the corresponding try 
suite. The f inally clause is an ideal location to place resource deallocation code for resources 
acquired and manipulated in the corresponding try suite. 

Objects of exception data types can be created with zero or more arguments. These arguments fre¬ 
quently are used to formulate error messages for a raised exception. 


When Python creates an exception object in a raise statement, Python places any arguments 
from the raise statement in the exception objecTs args attribute. 


When an exception occurs, Python remembers the exception that was raised and the current state 
of the program. Python also maintains traceback objects that contains information about the 
function call stack from the time the exception occurred. 


Python maintains information about functions that have been unwound from the stack with tra¬ 
ceback objects. 


An empty raise statement reraises the most recently raised exception. 

When Python encounters an except clause in which except is followed by an exception type 
(or tuple of exception types), a comma and an identifier, Python binds the identifier to the excep¬ 
tion object that the except handler catches. 

If an exception object’s args attribute is an empty tuple, the exception’s string representation is 
the empty string. 

If an exception objects’s args tuple contains only one value, the exception’s string representation 
is the string representation of that value. 

If an exception object’s args tuple contains multiple items, the exception’s string representation 
is the string representation of the args tuple. 

Module traceback contains many functions for manipulating the traceback objects that Py¬ 
thon creates during stack unwinding. 


Function traceback. print_exc, when called with no arguments, prints all the traceback 
objects accumulated thus far in the stack-unwinding process. 

A Python traceback object Stores information about a function call, including the file name, 
line numbers and the code that caused an error. 


Programmer-defined exception classes should derive directly or indirectly from class Exception. 
If a programmer-defined exception requires no extra functionality, the programmer can create the 
exception merely by inheriting from an existing exception class and placing keyword pass in the 
body of the class. 
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TERMINOLOGY 

args attribute of exception object 

out-of-range sequence subscript 

automatic garbage collection 

print_exc function of module traceback 

call stack 

raise an exception 

catch related errors 

raise statement 

divide by zero 

release a resource 

eliminate resource leaks 

reraise an exception 

empty except clause 

resource leak 

empty raise clause 

resumption model of exception handling 

error-processing code 

sqrt function of module math 

except handler 

stack unwinding 

except clause 

StandardError exception 

except suite expires 

Stoplteration exception 

exception 

SystemExit exception 

Exception class 

termination model of exception handling 

exception handler 

throw an exception 

fault-tolerant program 

throw point 

finally clause 

traceback module 

FormatException class 

traceback object 

function call stack 

try statement 

garbage collection 

try/except form 

IndexError exception 

try/except/else form of a try statement 

inheritance with exceptions 

try/f inally form of a try statement 

memory exhaustion 

programmer-defmed exception class 

memory leak 

Warning exception 

Modula-3 

ZeroDivisionError exception 

SELF-REVIEW EXERCISES 

12.1 Fili in the blanks in each of the following statements: 


a) Python uses exception handling to determine when a_loop terminates. 

b) A function is said to_an exception when it detects that a problem occurred. 

c) The_clause, if it appears after a try suite, always executes. 

d) Most basic Python exceptions derive from class_. 

e) The statement that raises an exception is sometimes called the_of the exception. 

f) A_statement encloses code that may raise an exception. 

g) If the catch-all exception handler is specified before another exception handler, a 
_may occur. 

h) An uncaught exception in a function causes that function to be_from the 

function call stack. 

i) Function f loat can raise a(n)_exception if its argument cannot be convert- 

ed to a floating-point value. 

j) Python maintains information about the functions unwound from the stack in 
_objects. 

12.2 State whether each of the following is true or false. If false, explain why. 

a) Exceptions always are handled in the function that initially detects the exception. 

b) Accessing a nonexistent object attribute causes an AttributeError exception. 

c) Accessing an out-of-bounds sequence subscript causes the interpreter to raise an exception. 

d) A try statement must contain one or more clauses. 

e) If a finally clause appears in afunction, that f inally clause is guaranteed to execute. 
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f) In Python, it is possible to return to the throw point of an exception via keyword return. 

g) Exceptions can be reraised. 

h) Function math. sqrt raises a NegativeNumberError exception if called with a 
negative-integer argument. 

i) Exception object attribute args contains a string that corresponds to the exception’s er¬ 
ror message. 

j) Exceptions can be raised only by functions explicitly called in try statements. 


ANSWERS TO SELF-REVIEW EXERCISES 

12.1 a) for. b) raise (or throw). c) f inally. d) Exception. e) throw point. f) try. g) syntax 
or logic error, h) unwound. i) ValueError. j) traceback. 

12.2 a) False. Although it is possible to handle an exception in the function that originally detects 
the exception, often an exception is handled by a calling function on the function call stack. b) True. 
c) True. d) True. e) False. The f inally clause will execute only if program control enters the cor- 
responding try suite and if the try suite does not terminate the program. f) False. It is not possible 
to return control to the throw point of an exception in Python, g) True. h) False. Function 
math. sqrt raises a ValueError exception if called with a negative-integer argument. i) False. 
Exception object attribute args contains a tuple that corresponds to the arguments used to initialize 
the exception object. j) False. Exceptions can be raised by any code, regardless of whether it is called 
from a try statement. Also, the interpreter can raise exceptions. 

EXERCISES 

12.3 Use inheritance to create an exception base class and various exception-derived classes. 
Write a program to demonstrate that the except clause specifying the base class catches derived- 
class exceptions. 

12.4 Write a Python program that demonstrates how various exceptions are caught with 

except Exception, exception 

12.5 Write a Python program that shows the importance of the order of exception handlers. Write 
two programs, one with the correct order of except handlers and another with an order that causes 
a logic error. If you attempt to catch a base-class exception type before a derived-class type, the pro¬ 
gram may produce a logic error. 

12.6 Exceptions can be used to indicate problems that occur when an object is being constructed. 
Write a Python program that shows a constructor passing information about constructor failure to an 
exception handler that occurs after a try statement. The exception raised also should contain the ar¬ 
guments sent to the constructor. 

12.7 Write a Python program that illustrates reraising an exception. 

12.8 Write a Python program that shows that a function with its own try statement does not have 
to catch every possible exception that occurs within the try suite. Some exceptions can slip through 
to, and be handled in, other scopes. 
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Objectives 

• To understand text processing in Python. 

• To use Python’s string data-type methods. 

• To manipulate and search string contents. 

• To understand and create regular expressions. 

• To use regular expressions to match patterns in 
strings. 

• To use metacharacters, special sequences and 
grouping to create complex regular expressions. 

The chief defect ofHenry King 
Was chewing little bits of string. 

Hilaire Belloc 

Vigorous writing is concise. A sentence should contain no 
unnecessary words, a paragraph no unnecessary sentences. 

William Stmnk, Jr. 

I have made this letter longer than usual, because I lack the 
time to make it short. 

Blaise Pascal 

The difference between the almost-right word & the right 
word is really a large matter — it’s the difference between the 
lightning bug and the lightning. 

Mark Twain 
Mum ’s the word. 

Miguel de Cervantes, Don Quixote de la Mancha 





-s* 


rm 
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13.1 Introduction 


(tt) 


This chapter introduces Python’s string and character processing capabilities and demon- 
strates using regular expressions to search for patterns in text. The techniques presented in 
this chapter can be employed to develop text editors, word processors, page-layout Soft¬ 
ware, computerized typesetting systems and other text-processing Software. Previous chap- 
ters presented several string-processing capabilities. In this chapter, we expand on this 
information by detailing the capabilities of various methods of the basic string data type and 
the powerful text-processing capabilities provided in the Python module re. 


13.2 Fundamentalsof Characteisand Sbings 

Characters (digits, letters and symbols such as $, @, % and *) are the fundamental building 
blocks of Python programs. Every program is composed of characters that, when grouped 
meaningfully, represent a series of instructions that the interpreter uses to perform a task. 
Each character has a corresponding character code (sometimes called its integer ordinal 
value). For example, the integer value 122 corresponds to the character constant " z". Py¬ 
thon provides function ord that takes as an argument a character and retums its character 
code (as shown in the interactive session of Fig. 13.1). In most modern programming lan- 
guages and systems, character values are established according to the Unicode character 
set —an international character set that contains many more symbols and letters than does 
the ASCII character set (see Appendix B, ASCII Character Set). To learn more about Uni¬ 
code, see Appendix F. 

Python supports strings as a basic data type. Recall that strings are immutable 
sequences—strings cannot be changed after they are created. We have seen how to obtain 
the length of a string with function len, how to concatenate strings with operator + and 
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Python 2.2b2 

(#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 

win32 


Type "help", 

"Copyright", "credits" or "license" for more informa- 

tion. 


»> ord( "z" 

) 

122 


»> ord ( " \n' 

) 

10 



Fig. 13.1 IntegerordinaI value of a character. 


how to format strings with format operator %. Strings also support methods that perform 
various other formatting and processing capabilities. The table in Fig. 13.2 lists the string 
methods. When a program invokes a string method that appears to modify the string, the 
method actually returns its results as a new string. In the table, the “original string” refers 
to the string on which a method is invoked. We discuss many of these methods in the fol- 
lowing sections. 




String Method 


capitalize() 


center ( width ) 

count ( substring], start[, end]] ) 


encode ( [encoding[, errors] ) 


endswith( substringi , start [, end]]) 


expandtabs ( [tabsize] ) 


Desc ription 

Returns a version of the original string in which 
only the first letter is capitalized. Converts any 
other capital letters to lowercase. 


Returns a copy of the original string centered 
(using spaces) in a string of width characters. 


Returns the number of times substring occurs in 
the original string. If argument start is specified, 
searching begins at that index. If argument end is 
indicated, searching begins at start and stops at 
end. 


Returns an encoded string. Python’s default 
encoding is normally ASCII. Argument errors 
defines the type of en'or handling used; by default, 
errors is "striet". 

Returns 1 if the string ends with substring. 

Returns 0 otherwise. If argument start is specified, 
searching begins at that index. If argument end is 
specified. the method searches through the slice 
starf.end. 

Returns a new string in which ali tabs are replaced 
by spaces. Optional argument tabsize specifies the 
number of space characters that replace a tab char¬ 
acter. The default value is 8. 








Fig. 13.2 String methods (Parti of 3.) 
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String Method 

Desc ription 

find( substringi, start[, end]] ) 

Returns the lowest index at which substring 
occurs in the string; retums -1 if the string does 
not contain substring. If argument start is speci- 
fied, searching begins at that index. If argument 
end is specified, the method searches through the 
slice starf.end. 

index ( substringi , start[, end]]) 

Performs the same operation as f ind, but raises a 
ValueError exception if the string does not 
contain substring. 

isalnum() 

Retums 1 if the string contains only alphanumeric 
characters (i.e., numbers and letters); otherwise, 
retums 0. 

isalpha() 

Returns 1 if the string contains only alphabetic 
characters (i.e., letters); returns 0 otherwise. 

isdigit() 

Returns 1 if the string contains only numerical 
characters (e.g., "0", "1", "2 "); otherwise, 
retums 0. 

islower() 

Returns 1 if all alphabetic characters in the string 
are lower-case characters (e.g., "a", "b", "c"); 
otherwise, returns 0. 

isspace() 

Returns 1 if the string contains only whitespace 
characters; otherwise, retums 0. 

istitle() 

Retums 1 if the first character of each word in the 
string is the only uppercase character in the word; 
otherwise, retums 0. 

isupper() 

Returns 1 if all alphabetic characters in the string 
are uppercase characters (e.g., "A", "B", "C"); 
otherwise, retums 0. 

join ( sequence ) 

Returns a string that concatenates the strings in 
sequence using the original string as the separator 
between concatenated strings. 

1 just ( width ) 

Returns a new string left-aligned in a whitespace 
string of width characters. 

lower() 

Returns a new string in which all characters in the 
original string are lowercase. 

lstrip() 

Returns a new string in which all leading 
whitespace is removed. 

replace ( old, new[, maximum ] ) 

Returns a new string in which all occurrences of 
old in the original string are replaced with new. 
Optional argument maximum indicates the maxi¬ 
mum number of replacements to perform. 

Fig. 13.2 String method s. (Part2of 3.) 

_ 
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String Method 

Desc ription 

rfind ( substringi, start[, end]] ) 

Retums the highest index value in which substring 
occurs in the string or -1 if the string does not con- 
tain substring. If argument start is specified, 
searching begins at that index. If argument end is 
specified, the method searches the slice starf.end. 

rindex ( substringi, start[, end]]) 

Performs the same operation as rf ind, but raises 
a ValueError exception if the string does not 
contain substring. 

r just ( width ) 

Returns a new string right-aligned in a string of 
width characters. 

rstrip () 

Returns a new string in which all trailing 
whitespace is removed. 

split ( [separator] ) 

Returns a list of substrings created by splitting the 
original string at each separator. If optional argu¬ 
ment separator is omitted or None, the string is 
separated by any sequence of whitespace, effec- 
tively returning a list of words. 

splitlines ( [keepbreaks] ) 

Returns a list of substrings created by splitting the 
original string at each newline character. If 
optional argument keepbreaks is 1, the substrings 
in the returned list retain the newline character. 

startswith ( substringi, start[, end]]) 

Returns 1 if the string starts with substring ; other- 
wise, retums 0. If argument start is specified, 
searching begins at that index. If argument end is 
specified, the method searches through the slice 
starf.end. 

strip() 

Returns a new string in which all leading and trail¬ 
ing whitespace is removed. 

swapcase () 

Returns a new string in which uppercase charac¬ 
ters are converted to lowercase characters and 
lower-case characters are converted to uppercase 
characters. 

title () 

Retums a new string in which the first character of 
each word in the string is the only uppercase char¬ 
acter in the word. 

translate ( table[, delete ] ) 

Translates the original string to a new string. The 
translation is performed by first deleting any char¬ 
acters in optional argument delete, then by replac- 
ing each character c in the original string with the 
value table [ ord ( c ) ]. 

upper () 

Returns a new string where all characters in the 
original string are uppercase. 

Fig. 13.2 String method s. (Part3of 3.) 

_ 
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13.3 String Presentation 

Strings require formatting for various reasons. For example, manipulating string presenta- 
tions enables users to read and understand program instructions or output more easily. This 
section presents two simple examples that demonstrate string-formatting methods. 
Figure 13.3 uses three string methods— center, 1 just and r just —to align strings. 
These methods use white space characters to manipulate the string formatting. 

String method center (line 6) takes one argument—an integer value—that corre- 
sponds to the total length of the output string. The method then creates a new string of this 
length and centers the original calling string (stringi) in 50 spaces so that an equal 
number of spaces appears to the right and left of the calling string. String method r just 
also aligns the stringi by preceding the calling string with 50 - len ( stringi ) 
space characters to right-align the string (line 7). Line 8 uses method 1 just to creates a 
new string that is left aligned by following the calling string with 50 - len ( stringi ) 
space characters. If the string is longer than the argument supplied to any of these methods, 
the method simply returns the original string. 

Fig. 13.4 demonstrates methods that strip (remove) whitespace from strings. Line 4 
creates a string, stringi, that contains leading and trailing whitespace. String method 
strip removes leading and trailing whitespace from the original string (line 7). String 
method lstrip removes only leading whitespace (line 8) and method rstrip removes 
only trailing whitespace (line 9). As the output demonstrates, these methods remove all 
whitespace, including spaces, newlines and tabs. 


1 # Fig. 13.3: figl3_03.py 

2 # Simple output formatting example. 

3 


4 

stringi = 

e . " 


5 




6 

print stringi.center( 

) 


7 

print stringi.rjust( 

) 


8 

print stringi. 1 just( 

) 



Now I am 

here. 

Now I am here. 

Now I am here. 



Fig. 

13.3 String justific ation. 



1 

# Fig. 13.4: figl3_04.py 


2 

# Stripping whitespace 

from a 

string. 

3 




4 

stringi = 



5 




6 

print Original string: 


% stringi 

7 

print Using strip: "%s 

% 

stringi.strip() 

8 

print 'Using left strip 


% stringi.lstrip() 

9 

print "Using right stri 


% stringi.rstrip() 


Fig. 13.4 Stripping whitespace from strings (Part 1 of 2.) 
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Original string: " 

This is a test string. 


Using strip: "This is a test string." 
Using left strip: "This is a test string. 


Using right strip: " 

This is a test string." 


Fig. 13.4 Stripping whitespace from strings. (Part 2 of 2. 


13.4 Searching Strings 

In many applications, it is necessary to search for a character or set of characters in a string. 
For example, a programmer creating a word processor would want to provide capabilities 
for searching through documents. To perform such tasks, Python provides methods such as 
find and index. When searching for a substring, we either can determine whether a 
string contains the substring, or we can retrieve the index at which a substring begins. 
Figure 13.5 searches for substrings at the beginning, middle and end of a string. 





1 

# Fig. 13.5: figl3_05.py 



2 

# Searching strings for a 

substring. 


3 




4 

# counting the occurrences 

of a substring 


5 

stringi = 



6 




7 

print '"test" occurs %d ti 

% \ 


8 

( stringi.count ( 

) , stringi ) 


9 

print '"test" occurs %d ti 


% \ 

10 

( stringi.count ( 

, , len ( stringi ) ) , stringi ) 


11 

print 



12 




13 

# finding a substring in a 

string 


14 

string2 = 



15 




16 

print '"%s" contains "or" 

% \ 


17 

( string2, string2.find ( ) ) 


18 




19 

# find index of "even" 



20 

try : 



21 

print "even" index is' 

string2.index ( " ) 


22 

except ValueError : 



23 

print "even" does not 

% string2 


24 




25 

if string2.startswith ( 

) : 


26 

print '"%s" starts with 

% string2 


27 









Fig. 13.5 String ssearched for sub strings. (Part 1 of 2.) 
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28 if string2.endswith( ): 

29 print 

30 

31 # searching from end of string 

32 print 'Index from end of "test 

33 % ( stringi, stringi.rfind( 

34 print 

35 

36 # find rindex of "Test" 

37 try: 

38 print 1 First occurrence of 

stringi.rindex( ) 

40 except ValueError: 

41 print ’"Test" does not 

42 

43 print 

44 

45 # replacing a substring 

46 string3 = 

47 

48 print , string3 

49 print 'Replaced "one" witl 

50 string3 . replace ( , 

51 print 


% string2 


\ 

) ) 


, \ 


% stringi 


\ 

) 

string3.replace( , , ) 


"test" occurs 4 times in 

Testi, test2, test3, test4, Test5, test6 
"test" occurs 2 times after 18th character in 

Testi, test2, test3, test4, Test5, test6 

"Odd or even" contains "or" starting at index 4 

"even" index is 7 

"Odd or even" starts with "Odd" 

"Odd or even" ends with "even" 

Index from end of "test" in "Testi, test2, test3, test4, Test5, test6" 
is 35 

First occurrence of "Test" from end at index 28 
Original: One, one, one, one, one, one 

Replaced "one" with "two": One, two, two, two, two, two 
Replaced 3 maximum: One, two, two, two, one, one 


Fig. 13.5 Stringssea nched forsubstrings. (Part 2 of 2.) 


Lines 5-11 use string method count to return the number of occurrences of a sub¬ 
string in a string or a string slice. If the method does not find the specified substring, the 
method returns 0. Line 8 prints the number of times the substring "test" occurs in 
stringi. Method count takes two optional arguments that specify a slice of the string 
to search. Line 10 passes arguments to count that cause the method to search stringi 
starting at index 18 (i.e., character "3") and terminating at the end of the string. This call 
produces the same resuit as the statement 

stringi[ :len( stringi ) ].count( ) 
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but the method call with optional arguments has the added benefit of better readability and 
better performance, because the program does not create a new slice. 

Lines 14-29 demonstrate string that search for substrings. Line 17 uses method f ind 
to return the lowest index at which the substring occurs. If a string does not contain the sub- 
string, the method returns -1. Method index (line 21) resembles method find, except 
that if a string does not contain the substring, the method raises a ValueError exception. 
A program can catch this exception and handle it appropriately, in the case that the string 
does not contain the specified substring. 

Lines 25-29 use methods that determine whether a string begins or ends with a specific 
substring. If the string begins with the substring, method startswith returns 1 (line 25). 
This call produces the same resuit as the expression 

string2[ :len( ) ] == 

If a string ends with the substring, method endswith returns 1 (line 28). Using this meth¬ 
od produces the same resuit as the expression 


string2[ -len( 


) : ] == 


The program can search for a substring starting from the end of a string. Lines 32-43 
use methods rf ind and rindex to determine whether stringi contains certain sub¬ 
strings. Method rf ind returns the index of the first occurrence of the substring searching 
from the end of the string. If the method does not find the substring, it returns -1. Method 
rindex returns the highest index at which the substring begins and raises a ValueError 
if the method does not find the substring. Our program catches the exception to handle the 
case where the string does not contain the specified substring. 

At times, a user may want to find substring to perform an action on that substring. For 
example, a user may perform a search for a current phrase in a document and replace that 
phrase with another phrase. Method replace takes two substrings and searches a docu¬ 
ment for the first substring then replaces that substring with the substring in the second 
argument. Line 50 replaces all occurrences of the substring "one" in string3 with the 
substring "two". Method replace takes an optional third argument that sets the max¬ 
imum number of replacements. Line 51 replaces up to three occurrences of substring 
"one" with substring "two". 


13.5 Joining and Sfslitting Strings 

A computer processes code in much the same way people process text when reading. When 
you read a sentence, your brain breaks the sentence into individual words, or tokens, each 
of which conveys a meaning. This process is known as tokenization. Interpreters perform 
tokenization because they break up statements into such individual components as key- 
words, identifiers, operators and other elements of a programming language. Tokens are 
separated by delimiters, typically whitespace characters such as blank, tab, newline and 
carriage return. Other characters also may be used as delimiters to separate tokens. In this 
section, we study string methods that perform delimiter-based string splitting and joining. 

Figure 13.6 demonstrates string methods split and join. Line 5 creates stringi, 
a comma-separated string of letters. Lines 7-11 demonstrate how to split a string into 
tokens using delimiters. Line 8 calls method split with no arguments, which splits the 
string at each occurrence of a whitespace character. The method returns a list of tokens and 
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1 # Fig. 13.6: figl3_06.py 

2 # Token splitting and delimiter joining. 


3 

4 # splitting strings 

5 stringi = 

6 

7 print , stringi 

8 print "Split string by space 

9 print "Split string by comma 

10 print "Split string by comma 

11 print 

12 

13 # joining strings 

14 listi = [ , , , 

15 string2 = 

16 

17 print , listi 

18 print 'Joining with 

19 % ( string2, string2.join 

20 print , 


, stringi.split() 

, stringi.split( ) 

, stringi.split( , ) 


] 


\ 

( listi ) ) 

.join( listi ) 


String is: A, B, C, D, 

E, F 




Split string by spaces 

['A, 

'B, ' 

»c 1 

r ^ r r 

'D,', 'E,', 'F'] 

Split string by commas 

l'A', 

B', 

' c, 

D’, ’ E', ’ F'] 

Split string by commas, 

max 2 : 

[ 'A’ 

, ' B', 

' C, D, E, F'] 

List is: ['A', 'B', 'C 

, 'D' , 

E 1 , 

’F' ] 


Joining with " ": A 

B C 

D 

E F 


Joining with A- 

-B-.-C- 

—D—. 

-E-.-F 



Fig. 13.6 Splitting and joining strings. 



the program displays the tokens. In line 9, method split receives the argument ", ", 
which represents the delimiter (the string is split at each occurrence of a comma). In line 
10, method split receives two arguments—the delimiter and an integer value that spec- 
iftes the maximum number of splits to perform. 

Given a list of tokens, method join combines the list with a pre-defined delimiter. 
Line 14 creates a list of letter tokens and line 15 creates a delimiter string2 that contains 
three underscore characters. Lines 18-19 show the results of calling string2’s 

join method. The method receives the list of tokens as an argument and returns a string 
where the tokens are joined by the underscore delimiter in string2. Line 20 demonstrates 
combining the print method with a call to a string’s join method. 



Performance Tip 13.1 

When building a complex string, it is more efficient to include the pieces in a list and then 
use method join to assemble the string, rather than using the concatenatiori (+) operator. 








13.6 Regular Expressions 

String methods allow programs to search for a specific substring. For instance, to determine 
whether a string contains the substrings representing the days of the week ("Monday", 
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"Tuesday", "Wednesday ", etc.), the programcan invoke string method f indfor each 
substring (i.e., the program needs to invoke method f ind seven times to search for every 
day of the week). Depending on the search, a program may need to invoke method f ind 
numerous time, an inefficient way to solve a problem. Regular expressions provide a more 
efficient and powerful alternative. A regular expression is a text pattern that a program uses 
to find substrings that match patterns. In the remainder of this chapter, we discuss Python’s 
various regular-expression capabilities. 



Good Programming Practice 13.1 

Use string methods where only simple processing is required. This prevents errors caused by 
the more complex regular expressions and increases program readability. 


We begin our discussion with a simple example (Fig. 13.7) in which we search various 
welcoming phrases for "hello", "Helio" and "world! 

Line 4 imports the regular-expression module re, which provides regular-expression 
processing capabilities in Python. List testStrings (line 7) contains the strings that are 
searched with the regular expressions created in line 8. Note that the regular expressions 
closely resemble the strings. 







1 

# 

Fig. 13.7: figl3_07.py 


2 

3 

# 

Simple regular-expression example. 


4 

5 

import re 


6 

# 

list of strings to search and expressions 

used to search 

7 

testStrings = [ , 

, 1 

8 

9 

10 

expressions = [ , , ] 

# 

search every expression in every string 


11 

for string in testStrings: 


12 




13 


for expression in expressions: 


14 




15 


if re.search( expression, string ): 


16 


print expression, 

, string 

17 


else : 


18 


print expression. 

, string 

19 




20 


print 


hello 

not found in string Hello World 


Hello 

found in string Hello World 


world! not found in string Hello World 


hello 

not found in string Hello world! 


Hello 

found in string Hello world! 


world! found in string Hello world! 


hello 

found in string hello world 


Hello 

not found in string hello world 


world! not found in string hello world 



Fig. 13.7 Regular-expression example. 
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The remainder of the program consists of a nested for loop that tests each regular 
expression in list expressions against each string in list testStrings. Function 
re. search looks for the first occurrence of a regular expression in a string and returns 
an object that contains the substring matching the regular expression. If the string does not 
contain the pattern, re . search returns None. The program determines whether the func¬ 
tion call returns a value, then prints an appropriate message. We discuss how to use the 
object returned by re . search in the next section. 

Each regular expression in this example is a substring of one of the test strings. In fact, 
line 15 could be replaced with the expression 

if string.find( expression ) >= 

and the program would produce the same resuit. In the remaining sections, we explore how 
to create more powerful regular-expression pattern strings. 

13.7 Compiling Regular Expressions and Manipulating Regular 
Expression Ob is 

This section examines compiled regular-expression objects and introduces the object re¬ 
turned by function re . search, which contains the results of a search. The re module 
normally compiles a regular expression into a form that the module uses to process a string. 
If a program uses the same regular expression several times, compiling the regular expres¬ 
sion in advance may make the program more efficient. Figure 13.8 demonstrates how to 
compile regular expressions in advance to create compiled regular-expression objects and 
shows how to use the object returned from re . search to view the search results. 

Function re. compile (line 11) takes as an argument a regular expression and returns 
an SRE_Pattern object that represents a compiled regular expression. Compiled regular 
expression objects provide all the functionality available in module re. For example, com- 
piled-expression object method search (line 22) corresponds to function re. search 
(line 20). As the output demonstrates, both approaches return an SRE_Match object. This 
object supports various methods for retrieving the results of regular-expression processing. 
Method group (lines 26-28) returns the substring that matches the pattern. We discuss this 
method further when we discuss grouping in Section 13.11. 


1 # Fig. 13.08: figl3_08.py 

2 # Compiled regular-expression and match objects. 

3 

4 import re 

5 

6 testString = 

7 formatString = 

8 

9 # create regular expression 

10 expression = 

11 compiledExpression = re.compile( expression ) 

12 

13 # print expression and compiled expression 

14 print formatString % ( , expression ) 


# string for formatting the output 
and compiled expression 


Fig. 13.8 Regular-expression compilation. (Part 1 of 2.) 
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15 print formatString % ( , 

16 compiledExpression ) 

17 

18 # search using re.search and compiled expression's search method 

19 print formatString % ( , 

20 re.search( expression, testString ) ) 

21 print formatString % ( , 

compiledExpression.search( testString ) ) 

23 

24 # print results of searching 

25 print formatString % ( , 

26 re.searchf expression, testString ).group() ) 

27 print formatString % ( , 

compiledExpression.search( testString ).group() ) 


The expression 

The compiled expression 

Non-compiled search 

Compiled search 

search SRE_Match contains 

compiled search SRE_Match contains 


: Helio 

<SRE_Pattern object at 0x00B60A20> 
: <SRE_Match object at 0x00D0F9B8> 

: <SRE_Match object at 0x00D0F9B8> 

: Helio 
: Helio 


Fig. 13.8 Regular-expression compilation. (Part 2 of 2.) 


13.8 Regular Expression Repetition and Placement Chaiacteis 


(«) 


We now begin our discussion on how to build more sophisticated pattern strings. Regular ex¬ 
pressions are like a “language within a language.” Much as Python has a strictly defined syn- 
tax for creating programs, regular expressions specify several characters for creating patterns. 
Most patterns are built using a combination of characters, metacharacters and escape se- 
quences. A metacharacter is a regular-expression syntax element, just as key word i f is a Py¬ 
thon syntax element. Characters match themselves. A metacharacter’s task is to repeat, group, 
place or classify one or more characters. This section introduces metacharacters for repeating. 
We discuss escape sequences and other metacharacters in the following sections. 

Figure 13.9 demonstrates the basic repetition metacharacters—?, + and *. Line 7 cre- 
ates a list of regular expressions that contain these symbols. Metacharacter ? matches 
exactly zero or one occurrences of the expression it follows. An expression can be a single 
character, an escape sequence, a class of characters (discussed in Section 13.9) or a group 
(discussed in Section 13.11). In our simple example, we use only a single character for all 
the expressions that precede a repeating metacharacter. For example, the first regular 
expression in line 7, "Hel?o" matches the letter H, followed by the letter e, followed by 
zero or one occurrences of the letter 1, followed by the letter o. 


1 

# Fig. 13.9: 

figl3_09.py 

2 

# Repetition 

patterns, matching vs searching. 

3 



4 

import re 


5 




Fig. 13.9 Searching and matching stringswith repetition metacharacters. (Part 1 of 2.) 
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6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 


testStrings = [ , , ] 

expressions = [ , , ] 

# match every expression with every string 

for expression in expressions: 

for string in testStrings: 

if re.match( expression, string ): 

print expression, , string 

else : 

print expression, , string 


print 

# demonstrate the difference between matching and searching 

expressioni = 
expression2 = 
expression3 = 


# match expressioni with testStrings[ 1 ] 

if re.match( expressioni, testStrings[ ] ): 

print expressioni, , testStrings[ ] 


# search for expressioni in testStrings[ 1 ] 

if re.search( expressioni, testStrings[ ] ): 

print expressioni, , testStrings[ 


] 



# search for expression2 in testStrings[ 1 ] 

if re.search( expression2, testStrings[ ] ): 

print expression2, , testStrings[ ] 


# search for expression3 in testStrings[ 1 ] 

if re.search( expression3, testStrings[ ] ): 

print expression3, , testStrings[ ] 


Hel?o matches Heo 

Hel?o matches Helo 

Hel?o does not match Hellllo 

Hel+o does not match Heo 
Hel+o matches Helo 
Hel+o matches Hellllo 

Hel*o matches Heo 
Hel*o matches Helo 
Hel*o matches Hellllo 


elo found in Helo 
elo$ found in Helo 






Fig. 13.9 Searching and matching stringswith repetition meta charae te is. (Part2of 2.) 
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Metacharacter + matches one or more occurrences of the expressiori it follows. For 
example, the second regular expression in line 7, "Hel+o", matches the letter H, foliowed 
by the letter e, followed by one or more occurrences of the letter 1, followed by the letter o. 
Metacharacter * matches zero or more occurrences of the expression it follows. For 
example, the third regular expression in line 7, "Hel*o", matches the letter H, followed by 
the letter e, followed by zero or more occurrences of the letter 1, followed by the letter o. 

Lines 10-19 contain a nested for loop that applies each regular expression from line 
7 to each string from line 6. Function re .match (line 14) matches an expression to a 
string. Unlike function re . search (which returns an SRE_Match object if any part of 
the string matches the expression), function re.match returns an SRE_Match object 
only if the beginning of the string matches the regular expression. 

Regular expressions can contain two additional metacharacters to place a pattern 
within a string. Metacharacter A indicates placement at the beginning of the string; meta¬ 
character $ indicates placement at the end of the string. A search or a match returns a value 
only if a string contains the specified pattern at the beginning or end of the string, respec- 
tively. Lines 22-40 create regular expressions that contain these metacharacters and use 
functions re . match and re. search to process a string. 

The regular expressions in lines 22-24 correspond to the sequence of characters 
"elo" anywhere in a string, at the beginning of a string and at the end of a string, respec- 
tively. Notice, from the output that function re . match returns None when passed argu- 
ments expressioni and testStrings [ 2 ], because the regular expression "elo" 
does not match the entire string "Helo". Similarly, function re. search returns None 
when passed arguments express±on2 and testStrings [ 1 ], because the string 
"elo" does not appear at the beginning of the string "Helo". 


13.9 Classes and Special Sequences 

In this section, we explore two more basic regular-expression building blocks— character 
classes and special sequences. A character class specifies a group of characters to match in 
a string. A special sequence is a shortcut for a common class of characters. 

The metacharacters [ and ] denote a regular expression class. A regular expression 
that contains a class matches one character in the class. For example, the regular expression 
class " [abc] " matches the letter a, the letter b or the letter c. Classes can use the - char¬ 
acter to specify a range of consecutive characters. For example, the regular expression 
" [a-d] " is identical to the regular expression " [abcd] ", 

When placed at the beginning of a class, the metacharacter A negates the class. This 
means that the regular expression matches ali characters excepi those specified in the class. 
For example, the class "[ A a-c]" matches any character but a, b and c. Special 
sequences (Fig. 13.10) describe commonly used classes of characters. 

Figure 13.11 demonstrates regular expressions that contain classes and special 
sequences. We also demonstrate how to avoid common regular-expression errors. The reg¬ 
ular expression in line 8 contains one new metacharacter and demonstrates an important 
point about using regular expressions. The metacharacter | matches either the regular 
expression to the left or to the right of the metacharacter. Another way to write the expres¬ 
sion " [ abc ] "is " a | b | c ". Thus, the regular expression in line 8 matches either the string 
"2x+5y" orthe string "7y-3z". 
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Spec ia I Sequenc e Desc ribes 


\d 

\D 

\s 

\S 

\w 

\W 

w 


The class of digits ( [ 0 - 9 ]). 

The negation of the class of digits ( [ A 0-9]). 

The whitespace characters class ([ \n\f \r\t\v] ). 

The negation of the whitespace charactere class ([ A \n\f \r\t\v] ). 
The alphanumeric characters class ( [a-zA-Z0-9_]). 

The negation of the alphanumeric characters class ([ A a-zA-Z0-9_]). 
The backslash (\). 


Fig. 13.10 Regular-expression special sequences. 
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# Fig. 13.11: figl3_ll.py 

# Program that demonstrates classes and special sequences. 
import re 

# specifying character classes with [ ] 

testStrings = [ , ] 

expressions = [ r , 

r 

r ] 

# match every expression with every string 

for expression in expressions: 

for testString in testStrings: 

if re.match( expression, testString ): 

print expression, , testString 

# specifying character classes with special sequences 

testStringl = 
testString2 = 
testString3 = 

expressioni = r 
expression2 = r 

# matching with character classes 

if re.match( expressioni, testStringl ): 

print expressioni, , testStringl 

if re.match( expressioni, testString2 ): 

print expressioni, , testString2 

if re.match( expression2, testString3 ): 

print expression2, , testString3 


(«) 






Fig. 13.11 Regularexpressionswith classesand special sequences. (Part 1 of 2.) 
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2x\+5y|7y-3z matches 2x+5y 
2x\+5y|7y-3z matches 7y-3z 
[0-9][a-zA-Z0-9_].[0-9][yz] matches 2x+5y 
[0-9][a-zA-Z0-9_].[0-9][yz] matches 7y-3z 
\d\w-\d\w matches 7y-3z 

A \d[3]-\d[3}-\d{4}$ matches 800-123-4567 
A \d[3]-\d[3}-\d{4}$ matches 617-123-4567 

\w+:\s+\w+@\w+\.(com|org|net) matches email: joe_doe@deitel.com 


Fig. 13.11 Regularexpressionswith classesand special sequences. (Part 2 of 2.) 


Notice that \ the escape metacharacter, precedes the character + in the regular expres- 
sion at line 8. This matches the character +, rather than using the repetition metacharacter 
+. If the + was not escaped, the regular expression would match one or more x characters, 
followed by the numeric character 5 (as shown in Fig. 13.12). 

Note also that the regular expression in line 8 is a raw string —i.e., a string created by 
preceding the string with the character r. Usually, when a \ appears in a string, Python 
interprets this character as an escape character and attempts to replace the \ and the char¬ 
acter that follows with the correct escape sequence. When a \ appears within a raw string, 
Python does not interpret the character as the escape character, but instead interprets the 
character as the literal backslash character. For example, Python interprets the string " \n" 
as one newline character, but it interprets the string r " \ n" as two characters—a backslash 
and the character n. 



Common Programming Error 13.1 


Placing a backslash at the end of a raw string results in a syntax error. 



Good Programming Practice 13.2 

Regular expression pattern strings often contain backslash characters. Using raw strings to 
create pattern strings eliminates the need to escape each backslash in the pattern string, thus 
making the pattern string easier to read. 


Lines 9-10 create two additional regular expressions. The metacharacter . matches 
any character in a string except for a newline. The regular expression in line 9 matches a 
digit, followed by an alphanumeric character, followed by any character except a newline. 


Python 2.2b2 (#26, Nov 16 2001, 11:44:11) [MSC 32 bit (Intel)] on 
win32 

Type "Copyright", "credits" or "license" for more information. 
>>> import re 

>>> print re.match ( "2x+5y", "2x+5y" ) 

None 

»> print re.match( "2x+5y", "2x5y" ) 

<SRE_Match object at 0x00932268> 

»> print re.match ( "2x+5y", "2xx5y" ) 

<SRE_Match object at 0x00949A88> 


Fig. 13.12 \ metacharacter in regularexpressions. 
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followed by a digit, followed by the letter y or the letter z. The regular expression in line 
10 uses special sequences to create a similar regular expression. This expression matches a 
digit, followed by an alphanumeric character, followed by the character -, followed by a 
digit, followed by an alphanumeric character. Lines 13-18 contain a nested for loop that 
attempts to match each expression from lines 8-10 to each string in line 7. 

The remainder of the program creates more complex regular expressions. The meta- 
characters { and } provide another way to repeat characters. The expression in line 25 
matches three digits (as specified between curly brackets), followed by the character -, 
three digits, another - and four digits. By placing the regular expression between metachar- 
acters A and $, we specify that we want the regular expression to match the entire string. 
We can also use the bracket metacharacters to specify a range of repetitions. For example, 
the expression " \d{ 1, 3 } " matches one, two or three digits. 

Line 26 creates a regular expression that matches one or more alphanumeric charac¬ 
ters, followed by a colon (:), followed by one or more whitespace characters, followed by 
one or more alphanumeric characters, followed by the @ character, followed by one or more 
alphanumeric characters, followed by the . character (notice the backslash to escape this 
regular expression character), followed by the sequence of characters com, org or net. 
The remainder of the program attempts to match the regular expressions to the test strings. 


13.10 Regular Expression Sbing-Manipulation Functions 

The first few sections of this chapter discussed basic string methods for string manipulation 
and promised a more powerful version of these methods that use regular expressions. Module 
re provides pattern-based, string-manipulation capabilities, such as substituting a substring 
in a string and splitting a string with a delimiter. Figure 13.13 demonstrates these capabilities. 


1 

# Fig. 13.13: figl3_ 

13. py 


2 

3 

# Regular-expression 

string manipulation. 


4 

5 

import re 



6 

testStringl = 

sentence ends in 5 st 

:ars *****" 

7 

testString2 = 



8 

testString3 = 



9 

formatString = 

s: %s" # string to 

format output 

10 




11 

print formatString % 

( 

testStringl ) 

12 




13 

# regular expression 

substitution 


14 

testStringl = re.sub 

( r , r , testStringl ) 

15 

print formatString % 

( 

, testStringl ) 

16 




17 

testStringl = re.sub 

( r 

testStringl ) 

18 

print formatString % 

( 

t 

19 

testStringl ) 



20 




21 

print formatString % 

( 

r 

22 

re.sub ( r , 

, testStringl ) 

) 


Fig. 13.13 Regular-expression-based string manipulation. (Parti of 2.) 
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23 

24 print formatString % ( 

25 re.sub ( r , , testString2, ) ) 

26 

27 # regular expressiori splitting 

28 print formatString % ( + testString2, 

29 re.split( r , testString2 ) ) 

30 

31 print formatString % ( + testString3, 

re.split( r , testString3 ) ) 


Original string 
A substituted for * 

"carets" substituted for "stars" 
Every word replaced by "word" 
Replace first 3 digits by "digit" 
Splitting 1,2,3,4,5,6,7 
Splitting l+2x*3-y 


: This sentence ends in 5 stars ***** 
: This sentence ends in 5 stars AAAAA 
: This sentence ends in 5 carets AAAAA 
: word word word word word word AAAAA 
: digit,digit,digit,4,5,6,7 
: ['1', '2', '3', '4', '5', '6', '7'] 

: [ '1' , '2x', '3', ’y>] 


Fig. 13.13 Regular-expression-based string manipulation. (Part2of 2.) 


Function re. sub (line 14) takes three arguments. The second argument is a substring 
that is substituted for every substring in the third argument that matches the pattern 
described by the first argument. Line 14 substitutes the caret character ( A ) for the asterisk 
character (*) in string testStringl. To replace the asterisk character, the method must 
use the regular expression because * is a metacharacter. Lines 21-22 replace every 

word ("\w+") by the substring "word". Lines 24-25 use the function’s optional fourth 
argument to specify a maximum number of replacements to perform. 

Function re. split takes two arguments. The first argument is a regular expression 
that describes a pattern delimiter. The function returns a list of tokens created by splitting 
the second argument at the delimiter. Lines 28-29 print the results of splitting variable 
testString2 on commas (,). Line 32 calls re . split, passing a delimiter pattern that 
matches one of five mathematical operators. Notice that this regular expression defines a 
class and escapes the - character, but not the * character. This demonstrates a subtle regular 
expression feature. When any character—except A (for negation) or - (for a range)— 
appears inside a class that character is interpreted literally as the character. Therefore, meta- 
characters such as $, + or * do not need to be escaped when they appear inside a class. 

13.11 Giouping 

In Fig. 13.8, we saw how a program can use method group to extract matching substrings 
from an SRE_Match object. This method arises from a more sophisticated regular-expres- 
sion technique— grouping. A regular expression may specify groups of substrings to match 
in a string. A program then searches or matches a string with the regular expression and 
extracts information from the matching groups. Figure 13.14 creates regular expressions 
with groups and prints the information extracted from these groups. 

The regular expression in line 12 describes three groups. The metacharacters ( and ) 
denote a group. The first group matches a word (\w+), followed by a space, followed by 
another word. The second group matches three digits, followed by the character -, followed 
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19 
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21 
22 
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25 

26 

27 

28 

29 

30 

31 

32 


# Fig. 13.14: figl3_14.py 

# Program that demonstrates grouping and greedy operations. 

import re 

formatStringl = 

# string that contains fields and expression to extract fields 

testStringl = \ 

expressioni = \ 
r 


print formatStringl % ( , 

re.match( expressioni, testStringl ).groups() ) 
print formatStringl % ( , 

re.match( expressioni, testStringl ).group( ) ) 

print 

# greedy operations and grouping 

formatString2 = 


# strings and patterns to find base directory in a path 

pathString = 


expression2 = 
print formatStringl % ( 
re.match( expression2, 


greedy operator expression 

r 

pathString ).group( ) ) 


expression3 = 

print formatStringl % ( , 

re.match( expression3, pathString ).group( ) ) 


Extract all user data 

('Albert Antstein', '123-4567', 

'albertg 

bug2bug.com') 



Extract user e-mail 

albert@bug2bug.com 


Greedy error 

/books/2001 


No error, base only 

/books 



Fig. 13.14 Regular-expression groupsand greedy operatois. 


by four digits. The third group matches one or more alphanumeric characters, followed by 
the character followed by one or more alphanumeric characters, followed by the char¬ 
acter ., followed by three alphanumeric characters. This regular expression matches the 
string in variable testStringl. The three groups match the name, phone number and e- 
mail address of the person, respectively. 

Lines 14—17 demonstrate the benefits of grouping. Line 15 calls function re. match, 
which retums an SRE_Match object. This object’s groups method returns a list of sub- 
strings. Each substring in the list corresponds to the substring that matches a group in the reg¬ 
ular expression. The first substring in the list matches the first group in the regular expression, 
and so on. The resuit of line 15 is that the program obtains the person’s name, phone number 
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and e-mail address. Line 17 calls the SRE_Match’s method group, passing integer value 3 
as an argument. This call returns the substring that matches the third group in the regular 
expression, which retrieves the e-mail address substring from testStringl. 

Regular-expression grouping introduces another subtle regular-expression issue. The 
metacharacters + and * are called greedy operators. A greedy operator attempts to match 
as many characters as possible. Sometimes this is not the desired behavior. Lines 20-32 
demonstrate the problem of greedy operators. Line 24 is a string that contains a sample path 
that might be part of a URL. Suppose we wish to write a regular expression that obtains the 
root directory name from the path (i.e., /books in this example). Lines 26-28 attempt this 
operation, but fail because of the greedy behavior of the + operator in expression2. 
When an operator is greedy the regular expression module tries to match as much of the 
expression that precedes the operator as possible. Initially, this causes expression2 to 
match the entire string. However, the regular expression module must allow for the rest of 
the pattern to be matched. In this case, the group that contains the greedy operator must be 
immediately followed by a slash (/) as specified in expression2. Therefore, the regular 
expression module searches backwards in the string until the regular expression module 
can guarantee that there is a slash (/) that will follow the initial group in expression2. 
Thus, the group that contains the greedy operator matches /books/2001. 

The regular expression in line 30 modifies the behavior of the greedy + operator to obtain 
the root directory name in the sample path correctly. Placing the ? metacharacter after the 
greedy + operator changes the behavior of the + operator. Now, when the regular expression 
module searches the string using expression3, the module searches one character at a 
time until it finds the smallest string that matches the pattern in the group (i.e., /books). 

This chapter presented basic string manipulation capabilities, as well as how to use the 
powerful regular-expression-processing capabilities of module re. Chapter 14 introduces 
file processing, which enables programs to read information from files on disk and write 
information to files on disk. Many programs that process files use regular expressions and 
other string-processing capabilities to search and manipulate the contents of those files. 


13.12 Internet and World Wide Web Resources 

The following resources offer more information about the complex topic of regular expres¬ 
sions. 

etext.lib.virginia.edu/helpsheets/regex.html 

This tutorial discusses common regular expression uses, writing complex regular expressions and oth¬ 
er topics like escape characters and anchors. 

www.zvon.org/other/reReference/Output 

This reference describes common regular expression special sequences. 

py-howto.sourceforge.net/regex/regex.html 

This tutorial discusses using regular expressions and the re module. Topics covered include common 
problems, modifying strings and pattern matching. 

www. devshed.com/ Server_Side/Administration/RegExp 

This article describes common uses of regular expressions. 

py-howto.sourceforge.net/regex/regex.html 

This document contains information about regular-expression processing with module re, and dis¬ 
cusses greedy operators and how to use raw strings as regular-expression pattern strings. 
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SUMMARY 

• Python represents strings as sequences of characters. Characters are the fundamental building 
blocks of Python source programs. Every program is composed of a sequence of characters that— 
when they are grouped together meaningfully—is interpreted by the computer as a series of in- 
structions used to accomplish a task. 

• Each character has a corresponding character code (sometimes called its integer ordinal value) the 
ASCII or Unicode character set. 

• Python supports strings as a basic data type. 

• Strings are immutable sequences—once a string is created, it cannot be changed. 

• Methods center. 1 just and r just control how a string is output by “padding” the string with 
space characters. Method center takes one argument, which corresponds to the length of the out¬ 
put string. The method then creates a new string of this length and centers the calling string in the 
specified number of spaces. Method r just right-justifies the calling string by preceding the 
string with the difference of the specified number of spaces and the length of the calling string. 
Method 1 just creates a new string where the calling string is followed by the difference of the 
specified number of spaces and the length of the calling string. 

• String method strip removes leading and trailing whitespace from the calling string. String 
method lstrip removes only leading whitespace. Method rstrip removes only trailing 
whitespace. 

• String method count returns the number of times the substring occurs in the string. If the method 
does not find the specified substring, the method returns 0. 

• Method find returns the lowest index in the string that begins the specified substring. If the string 
does not contain the specified substring, the method returns -1. 

• Method index is similar to method find. However, if the method does not find the specified 
substring, the method raises a ValueError exception. 

• Method startswith returns 1 if the string begins with the specified substring. 

• Method endswith returns 1 if the string ends with the specified substring. 

• Method rfind is similar to method find, except the former returns the highest index at which 
the specified substring begins. If the method does not find the specified substring, it returns —1. 

• Method rindex is similar to method index, except that rindex returns the highest index at 
which the specified substring begins (and raises a ValueError if the method does not find the 
substring). 

• Method replace receives two substrings as arguments. The method searches the calling string 
for the first substring and replaces that substring with the second argument. Method replace 
takes an optional third argument that specifies the maximum number of replacements. 

• When you read a sentence, your mind breaks the sentence into words, or tokens, each of which con- 
veys meaning to you. Interpreters also perform tokenization. They break up statements into individ- 
ual pieces like keywords, identifiers, operators and other elements of a programming language. 

• Tokens are separated from one another by delimiters, typically whitespace characters such as blank, 
tab, newline and carriage retum. Other characters also may be used as delimiters to separate tokens. 

• Method split returns a list of tokens. When a call to method split passes no arguments, the 
method splits the string by any whitespace. The method takes an optional second argument that 
specifies the maximum number of splits to perform. 

• Given a list of tokens, method join joins that list with a delimiter. The method receives the list 
of tokens as an argument and returns a string where the tokens are joined by the delimiter specified 
in the calling string. 
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A regular expression is a text pattem that a program uses to find substrings that match pattems. 
The re regular-expression module provides regular expression capability in Python. 

Function re. search looks for the first occurrence of a regular expression in a string and retums 
an object that contains the substring matching the regular expression. If the string does not contain 
the pattern, re . search retums None. 

Compiling regular expressions can make programs more efficient. To use a regular expression, the 
re module first compiles the expression into a forni that the module uses to process a string. 
Function re. compile takes as an argument a regular expression and returns an SRE_Pattern 
object that represents a compiled regular expression. Compiled regular expression objects provide 
ali the functionality available in module re. 

SRE_Match methods enable a program to retrieve the results of regular-expression processing. 


Most patterns are built using a combination of characters, metacharacters and escape sequences. 
A metacharacter is a regular-expression syntax element. A metacharacter s job is to repeat, group, 
place or classify. 

Metacharacter ? matches exactly zero or one occurrences of the expression it follows. Metachar¬ 
acter + matches one or more occurrences of the expression it follows. Metacharacter * matches 
zero or more occurrences of the expression it follows. 


Function re .match matches an expression to a string. Unlike function re. search (which re¬ 
tums an SRE_Match object if any part of the string matches the expression), function re . match 
returns an SRE_Match object only if the beginning of the string matches the regular expression. 


Metacharacter A indicates placement at the beginning of the string; metacharacter $ indicates 
placement at the end of the string. 

A character class specifies a group of characters to match in a string. 


A special sequence is a shortcut for a cornmon class of characters. 


The metacharacters [ and ] denote a regular expression class. A regular expression that contains 
a class matches one character in the class. 


Classes can use the - character to specify a range of consecutive characters. 

When placed within a class as the first character after the square bracket, metacharacter A negates 
the class—the regular expression matches ali characters except those specified in the class. 

The metacharacter | matches either the regular expression to the left of the | or the regular ex¬ 
pression to the right. 

A raw string is created by preceding the string with the character r. 

Usually, when a \ appears in a string, Python interprets this character as an escape character and 
attempts to replace the \ and the character that follows with the correct escape sequence. 

When a \ appears within a raw string, Python does not interpret the character as the escape char¬ 
acter, but instead as the literal backslash character. 

The metacharacter . matches any character in a string except for a newline. 

The metacharacters { and } provide another way to repeat characters. 

By placing a regular expression between metacharacters A and $, we specify that we want the reg¬ 
ular expression to match the entire string. 

Module re provides pattem-based, string-manipulation capabilities, such as substituting a sub¬ 
string in a string and splitting a string with a delimiter. 

Function re. sub takes three arguments. The second argument is a substring that is substituted 
for every substring in the third argument that matches the pattern described by the first argument. 
The function’s optional fourth argument specifies a maximum number of replacements to perform. 
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• Function re. split takes two arguments. The First argument is a regular expressiori that de¬ 
scribes a pattern delimiter. The function returns a list of tokens created by splitting the second ar¬ 
gument at the delimiter. 

• If metacharacters such as $, + or * appear inside a class, they do not need to be escaped. 

• Method group extracts matching substrings from an SRE_Match object. A regular expression 
may specify groups of substrings to match in a string. The metacharacters ( and ) denote a group. 

• Function re. match returns an SRE_Match object. This object’s groups method returns a list of 
substrings. Each substring in the list corresponds to the substring that matches a group in the regular 
expression. The first substring in the list matches the first group in the regular expression, and so on. 

• The metacharacters + and * are called greedy operators. A greedy operator attempts to match as 
many characters as possible. 


TERMINOLOGY 


$ metacharacter 

istitle method 

% metacharacter 

isupper method 

( metacharacter 

join method 

) metacharacter 

1 just method 

* metacharacter 

lower method 

+ metacharacter 

lstrip method 

. metacharacter 

metacharacter 

? metacharacter 

ord function 

\ metacharacter 

raw string 

[ metacharacter 

re module 

] metacharacter 

re. compile function 

A metacharacter 

re. match function 

{ metacharacter 

re. search function 

} metacharacter 

re. split function 

| metacharacter 

re. sub function 

capitalize method 

regular expression 

character 

replace method 

character class 

rf ind method 

center method 

rindex method 

count method 

r just method 

delimiter 

rstrip method 

encode method 

search method 

endswith method 

split method 

escape sequence 

splitlines method 

expandtabs method 

SRE MATCH object 

f ind method 

SRE_Pattern object 

greedy operator 

startswith method 

group method 

string 

groups method 

strip method 

index method 

swapcase method 

integer ordinal value 

title method 

isalnum method 

token 

isalpha method 

tokenization 

isdigit method 

translate method 

islower method 

upper method 

isspace method 

white space character 
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SELF REVIEW EXERCISES 

13.1 Fili in the blanks in each of the following: 

a) Method_returns a new string where ali leading and trailing whitespace has 

been removed. 

b) Python represents strings as sequences of_. 

c) Method_returns the number of times a specified substring occurs in a string. 

d) Tokens are separated from one another by_. 

e) A _is a text pattern that a program uses to process strings. 

f) Function_looks for the first occurrence of a regular expression in a string. 

g) The task of a_is to repeat, group, place or classify one or more characters. 

h) Method _ takes a regular expression as an argument and returns an 

object that represents a compiled regular expression. 

i) Compiled regular expressions provide ali the functionality available in module 


j) The metacharacters_and_denote a regular expression class. 

13.2 State whether each of the following is true or false. If false, explain why. 

a) String method capitalize returns a new string where the first character of each word 
in the string is the one and only uppercase character in the word. 

b) String method f ind searches a string for a substring and raises a ValueError excep- 
tion if the string does not contain a substring. 

c) Method rindex returns the highest index at which the specified substring begins. 

d) Most string methods modify the string in-place. 

e) Any string can be treated as a regular expression. 

f) Metacharacter ? matches exactly one occurrence of the expression it follows. 

g) Method group returns an SRE_Match object. 

h) Method re . match does not search through a string, but returns a match object only if 
the string matches the specified regular expression starting from the beginning. 

i) The class [ A 0-9] matches any digit but 0. 

j) Preceding a string with the character r creates a raw string. 

ANSWERS TO SELF REVIEW EXERCISES 

13.1 a) strip. b) characters. c) count. d) delimiters. e) regular expression. f) re. search. 
g) metacharacter. h) re . compile. i) re. j) [, ]. 

13.2 a) False. String method title returns a new string where the first character of each word in 
the string is the one and only uppercase character in the word. b) False. String method index search¬ 
es a string for a substring and raises a ValueError exception if the string does not contain a sub¬ 
string. c) True, d) False. Strings are immutable, so string methods that appear to modify a string 
actually return a new string. e) True. f) False. Metacharacter ? matches exactly zero or one occurrenc- 
es of the expression it follows. g) False. Method group returns the substring that matches a regular 
expression. h) True. i) False. The class [ A 0-9] excludes ali digits. j) True. 

EXERCISES 

13.3 Use a regular expression to count the number of digits, non-digit characters, whitespace char¬ 
acters and words in a string. 

13.4 Use a regular expression to search through an XF1TML string and to locate ali valid URLs. For 
the purpose of this exercise, assume that a valid URL is enclosed in quotes and begins with http : //. 
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13.5 Write a regular expression that searches a string and matches a valid number. A number can 
have any number of digits, but it can have only digits and a decimal point. The decimal point is op- 
tionai, but if it appears in the number, there must be only one, and it must have digits on its left and 
its right. There should be whitespace or a beginning or end-of-line character on either side of a valid 
number. Negative numbers are preceded by a minus sign. 

13.6 Write a program that receives XHTML as input and outputs the number of XHTML tags in 
the string. The program should count the number of tags nested at each level. For example, the XHT¬ 
ML: 


hi 


has a p tag (nesting level 0—i.e., not nested in another tag) and a strong tag (nesting level 1). 

13.7 Write a function that takes a list of dollar values separated by commas, converts each number 
from dollars to pounds (at an exchange rate 0.667 dollars per pound) and prints the results in a com- 
ma-separated list. Each converted value should have the £ symbol in front of it. This Symbol can be 
obtained by passing the ASCII value of the symbol (156) to the chr function, which returns a string 
composed of that character. Ambitious programmers can attempt to do the conversion ali in one state- 
ment. 

13.8 Write a program that asks the user to enter a sentence and checks whether the sentence con- 
tains more than one space between words. If so, the program should remove the extra spaces. For ex¬ 
ample, "Helio World" should be "Helio World". (Hint: Use split and join.) 
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Objectives 

• To create, read, write and update files. 

• To become familiar with sequential-access file 
Processing. 

• To understand random-access file processing via 
module shelve. 

• To specify high-performance, unformatted I/O 
operations. 

• To understand the differences between formatted and 
raw data-fde processing. 

• To build a transaction-processing program with 
random-access file processing. 

• To serialize complex objects for storage. 

I read part of it ali the way through. 

Samuel Goldwyn 

I can only assume that a “Do Not File ” document isfiled in 

a “Do Not File” file. 

Senator Frank Church 

Senate Intelligence Subcommittee Hearing, 1975 
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14.4 Creating a Sequential-Access Rle 

14.5 Reading Data from a Sequential-Access Rle 

14.6 Updating Sequential-Access Rles 

14.7 Random-AccessRles 

14.8 Simulating a Random-Access Rle: The shelve Module 

14.9 Writing Data to a shelve Rle 

14.10 Retrieving Data from a shelve Rle 

14.11 Example: A Transaction-Processing Program 

14.12 ObjectSerialization 

Summary • Terminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 


14.1 Introduction 

Variables and sequences offer only temporary storage of data—the data is lost when a local 
variable “goes out of scope” or when the program terminates. By contrast, /z7<?.v are used for 
long-term retention of large amounts of data, even after the program that created the data 
terminates. Data maintained in files often is called persistent data. Computers store files on 
secondary storage devices, such as magnetic disks, optical disks and tapes. In this chapter, 
we explain how Python programs create, update and process data files. We consider both 
sequential-access files and random-access files , indicating the types of applications for 
which each is best suited. We compare formatted data-file processing and raw data-file Pro¬ 
cessing, and we also examine various file-based data storage mechanisms, such as the 
shelve and cPickle modules. 


14.2 Data Hera rchy 

Ultimately, all data items processed by computers are reduced to combinations of zeros and 
ones. This occurs because it is simple and economical to build electronic devices that can 
assume two stable States— 0 represents one state and 1 represents the other. It is remarkable 
that the impressive functions performed by computers involve only the most fundamental 
manipulations of Os and ls. 

The smallest data item that computers support is called a bit (short for “binary digit ”— 
a digit that can assume one of two values). Each data item, or bit, can assume either the value 
0 or the value 1. Computer circuitry performs various bit manipulations, such as examining 
the value of a bit, setting the value of a bit and reversing the value of a bit (from 1 to 0 or from 
0 to 1). For more information on binary numbers, refer to Appendix C, Number Systems. 

Programming with data in the low-level form of bits is cumbersome. It is preferable to 
program with data in forms such as decimal digits (e.g., 0, 1,2, 3,4, 5, 6, 7, 8, and 9), letters 
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(e.g., A through Z and a through z) and special symbols (e.g., $, @, %, &, *, (,), -, +, 

?, /, etc.). Digits, letters and special symbols are referred to as characters. The set of all 
characters used to write programs and represent data items on a particular computer is 
called that computer’s character set. Because computers can process only ls and Os, every 
character in a computer’s character set is represented as a pattern of ls and Os. Bytes are 
composed of eight bits. Programmers create programs and data items with characters; com¬ 
puters manipulate and process these characters as patterns of bits. 

Just as characters are composed of bits, fields are composed of characters (or bytes). A 
field is a group of characters that convey a meaning. For example, a field consisting of only 
uppercase and lowercase letters can represent a person’s name. 

Data items processed by computers form a data hierarchy in which data items become 
larger and more complex in structure in the progression from bits, to characters (bytes), to 
fields and upto larger data structures. 

Typically, a record, which we can represent as a tuple, dictionary or instance in 
Python, is composed of several fields. In a payroll system, for example, a record for a par¬ 
ticular employee might consist of the following fields: 

1. Employee Identification number 

2. Name 

3. Address 

4. Hourly salary rate 

5. Number of exemptions claimed 

6. Year-to-date earnings 

7. Amount of federal taxes withheld 

Thus, a record is a group of related fields. In the preceding example, each field is asso- 
ciated with a particular employee. A company has a payroll record for each employee. A 
file is a group of related records. 1 A company’s payroll file normally contains one record 
for each employee. Thus, a payroll file for a small company might contain only 22 records, 
whereas a payroll file for a large company might contain 100,000 records. It is not unusual 
for a company to have many files, some containing millions of characters of information. 
Figure 14.1 illustrates the data hierarchy. 

To facilitate the retrieval of specific records from a file, at least one field in each record 
is chosen as a record key. A record key identifies a record as belonging to a particular 
person or entity and distinguishes that record from all other records in the file. In the payroll 
record described previously, the employee-identification number would normally be 
chosen as the record key. 

There are many ways to organize records in a file. The most common organization is 
called a sequential file, in which records typically are stored in order by the record-key field. 
In a payroll file, records usually are placed in order by employee-identification number. The 
first employee record in the file contains the lowest employee-identification number, and sub- 
sequent records contain increasingly higher employee-identification numbers. 


1. Generally, a file can contain arbitrary data in arbitrary formats. In some operating systems, a file 
is viewed as nothing more than a collection of bytes. In such an operating system, any organization 
of bytes in a file (such as organizing the data into records) is a view created by the application’s 
programmer. 
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01001010 Byte (ASCII characterj) 

1 Bit 



Fig. 14.1 Data hiera rchy. 


Most businesses use many different files to store data. For example, companies might 
have payroll files, accounts-receivable files (listing money due from clients), accounts-pay- 
able files (listing money due to suppliers), inventory files (listing facts about all the items 
handled by the business) and many other types of files. Sometimes, a group of related files 
is called a database. A collection of programs designed to create and manage databases is 
called a database management system (DBMS). We discuss databases in detail in 
Chapter 17, Database Application Programming Interface (DB-API). 

14.3 Files and Streams 

Python views each file as a sequential stream of bytes (Fig. 14.2). Each file ends either with 
an end-of-file marker or at a specific byte number recorded in a system-maintained admin¬ 
istrative data structure. When a program opens a file, Python creates an object and associ- 
ates a stream with that object. 


0 12345678 9 ... n-1 

. . . end-of-file marker 








Fig. 14.2 Python's view of a file of n bytes 
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When a Python program begins execution, Python creates three file streams— 
sys. stdin ( Standard input stream), sys. stdout ( Standard output stream) and 
sys. stderr ( Standard error stream). These streams provide communication channels 
between a program and a particular file or device. Python file streams are created regardless 
of whether a Python program imports the sys module, although a program must import the 
sys module to access the streams directly. Program input corresponds to sys . stdin. In 
fact, raw_input uses sys . stdin to retrieve user input. Program output corresponds to 
sys . stdout. The print statement sends information to the Standard output stream, by 
default. Program errors are printed to sys . stderr. 

The sys. stdin stream enables a program to receive input from the keyboard or 
other devices, the sys . stdout stream enables a program to output data to the screen or 
other devices and the sys . stderr stream enables a program to output error messages to 
the screen or other devices. 

14.4 Creating a Sequential-Access File 

Python imposes no structure on a file—notions like “records” do not exist in Python files. 
This means that the programmer must structure files to meet the requirements of applica¬ 
tioris. In the example in this section, we impose a record structure on a file. 

Figure 14.3 creates a simple sequential-access file that might be used by an accounts- 
receivable system to track the money owed by a company’s client. For each client, the pro¬ 
gram obtains an account number, the client’s name and account balance (i.e., the amount 
the client owes the company). The data obtained for each client constitutes a record for that 
client. The account number represents the record key in this application; that is, the file will 
be created and maintained in account-number order. In our example, we assume a user 
enters the account information in account-number order. In a comprehensive accounts- 
receivable system, a sorting capability would be provided so the user could enter the 
records in any order—the records would then be sorted before being written to the file. 

As stated previously, a programmer creates file-stream objects to open files. Function 
open, which receives one required argument and two optional arguments, creates a stream 
object (line 8). The required argument for the new stream object is the file name', the two 
optional arguments are the file-open mode and the buffering mode. 


1 

# Fig. 14.3: figl4_03.py 





2 

# Opening and writing to a file. 





3 






4 

import sys 





5 






6 

# open file 





7 

try : 





8 

file = open( , 

) 

open 

file 

in write mode 

9 

except IOError, message: 

# 

file 

open 

failed 

10 

print >> sys.stderr, 

ld not 



, message 

11 

sys.exit ( ) 





12 






13 

print "Enter the account, name an 





14 

print "Enter end-of-file to end i 






Fig. 14.3 File-stream objectsforopening and writing data to a file. (Part 1 of 2.) 
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15 

16 while : 

17 

18 try: 

19 accountLine = raw_input( ) 

20 except EOFError: 

21 break # user entered EOF 

22 else: 

23 print » file, accountLine 

24 

25 file.close() 




Enter the account, name and balance. 
Enter end-of-file to end input. 

? 100 Jones 24.98 
? 200 Doe 345.67 
? 300 White 0.00 
? 400 Stone -42.16 
? 500 Rich 224.62 
? A Z 


Fig. 14.3 File-stream objectsforopening and writing data to a file. (Part 2 of 2.) 


The file-open mode indicates whether a user can open the file for reading, writing or 
both. File-open mode " w" opens a file to output data to the file. Existing files opened with 
mode "w" are truncated —ali data in the file is deleted—and re-created with the new data. 
If the specified file does not yet exist, then a file is created. The newly created file is 
assigned the name provided in the file name argument (i.e., clients . dat). If the loca- 
tion of the file is not specified in the file name argument, Python attempts to create the file 
in the current directory. If the file open-mode argument is not specified, the default value 
is "r ", which opens a file for reading. Figure 14.4 lists various file-open modes. The third 
argument to function open —the buffering-mode argument—is for advanced control of 
file input and output and usually is not specified. We do not assign a value to the buffering- 
mode argument in this example. 


Mode Descriptiori 


"a" Writes all output to the end of the file. If the indicated file does not exist, it is 

created. 

" r " Opens a file for input. If the file does not exist, an IOEr ror exception is raised. 

" r+ " Opens a file for input and output. If the file does not exist, causes an IOError 

exception. 

" w" Opens a file for output. If the file exists, it is truncated. If the file does not exist, 

one is created. 

" w+ " Opens a file for input and output. If the file exists, it is truncated. If the file does 

not exist, one is created. 








Fig. 14.4 File-open modes. (Part 1 of 2.) 
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Mode Descriptiori 

"ab" , "rb" , Opens a file for binary (i.e., non-text) input or output. [Note: These modes are 
"r+b", supported only on the Windows and Macintosh platforms.] 

"wb", "w+b" 




Fig. 14.4 File-open modes. (Part2of 2.) 


Common Programming Error 14.1 



Opening an existing file for output ( "w") when the user wants to preser\>e the file is a logic 
error , because the contents of the file are discarded without warning. 


When open encounters an error, the function raises an IOError exception. Some 
possible errors include attempting to open a file for reading that does not exist, opening a 
read-only file for writing and opening a file for writing when no disk space is available. 

In Fig. 14.3, if open raises an IOError exception, line 10 prints the error message 
"File could not be opened" to sys . stderr. By default, the print statement 
sends output to the sys. stdout file object. Programs can redirect output from the 
print statement to print to a different file object. In our example, the statement 


print » sys.stderr, 


message 


redirects output to the sys . stderr (Standard error) file object. When >> Symbol follows 
the print keyword, the print statement redirects the output to the file object that ap- 
pears to the right of >>. A comma follows the output file object, and the value to print fol¬ 
lows the comma. 



Common Programming Error 14.2 


When redirecting file output with », forgetting to put a comma (,) after the file object is a 
syntax error. 


Redirecting output with » was added to Python in version 2.0. For earlier versions, 
or to support multiple versions, the effect of redirecting output with the » Symbol can be 
accomplished with file object method write as follows: 


sys . stderr. write ( output ) 

The table in Fig. 14.5 lists the file-object methods. 


Method 


Desc ription 


close () Closes the file object. 

f ileno () Returns an integer that is the file’s file descriptor (i.e., the 

number the operating system uses to maintain information about 
the file). 






Fig. 14.5 File-object methods. (Part lof 2.) 
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Method 

Desc ription 

flush() 

Flushes the file’s buffer. A buffer contains the information to be 
written to or read from a file. Flushing the buffer performs the 
read or write operation. 

isatty() 

Returns 1 if the file object is a tty (terminal) device. 

read( [size] ) 

Reads data from the file. If size is not specifted, the method 
reads all data to the end of the file. If argument size is specified, 
the method reads at most size bytes from the file. 

readline ( [size] ) 

Reads one line from the file. If size is not specified, the method 
reads to the end of the line. If size is specified, the method reads 
at most size bytes from the line. 

readlines ( [size] ) 

Reads lines from the file and returns the lines in a list. If size is 
not specified, the method reads to the end of the file. If size is 
specified, the method reads at most size bytes. 

seek ( offset[, location] ) 

Moves the file position offset bytes. If location is not specified, 
the file position moves offset bytes from the beginning of the 
file. If location is specified, the file position moves offset bytes 
from location. Section 14.5 discusses seek in detail. 

teli() 

Returns the ftle’s current position. 

truncate ( [size] ) 

Truncates data in the file. If size is not specified, all data is 
deleted. If size is specified, the file is truncated to contain at 
most size bytes. 

write ( output ) 

Writes the string output to the file. 

writelines ( outputList ) 

Writes each string in outputList to the file. 

xreadlines() 

Similar to readlines, except the method implements a more 
memory-efficient way to read a file. The method returns an 
xreadlines object that a program can iterate over to retrieve 
the information. See www.python.org/doc/current/lib/ 
module-xreadlines . html for information on xreadlines 
objects. 


Fig. 14.5 File-object methods. (Part2of 2.) 



If an error occurs when the program in Fig. 14.3 opens a file, function sys .exit 
(line 11) terminates the program. Function sys . exit returns its optional argument to the 
environment from which the program was invoked. Argument 0 (the default) indicates 
normal program termination; any other value indicates that the program terminated due to 
an error. The calling environment (most likely the operating system) uses the value returned 
by sys . exit to respond to the error appropriately. 

If the file, clients . dat, opens successfully, the program processes data. Lines 13- 
14 prompt the user to enter the various fields for each record, or the end-of-file marker 
when data entry is completed. 

Lines 16-23 extract each set of data from the Standard input using a try/except/ 
else block in a repetition structure. Function raw_input retrieves a line of input from 
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the user. If the user enters the end-of-file character, raw_input raises an EOFError 
exception. Lines 20-21 catch this error and use a break statement to exit the infinite 
while loop. If the user does not enter the end-of-file character, the else block (lines 22- 
23) executes and prints the user-entered line to the output file using the >> Symbol. 

The close method (line 25) closes the file object after the while loop terminates. 
Although Python closes open files when a program terminates, it is good practice to close 
a file with the close method as soon as the program no longer needs the file. 

Performance Tip 14.1 

Close eachfile explicitly as soon as it is known that the program will not reference the file 
again. This can reduce resource use in a program that continues executing after it no longer 
needs a particular file. This practice also improves program clarity. 

In the sample execution for the program of Fig. 14.3, the user enters information for 
five accounts and signals that data entry is complete by entering end-of-file. This dialog 
does not show how the data records actually appear in the file. To verify that the file has 
been created successfully, the next section demonstrates a program that reads the file and 
displays its contents. 

14.5 Reading Data from a SequentiaI-Access File 

Data is stored in files so that the data can be retrieved for processing at a later time. The 
previous section demonstrated how to create a sequential-access file. In this section, we dis- 
cuss how to read (or retrieve) data sequentially from a file. 

Figure 14.6 reads records from the file clients .dat created by the program of 
Fig. 14.3 and displays the contents of each record. Files are opened for reading by passing 
an "r" as the second argument to function open (line 8). If the locatin of the file is not 
specified in the file name argument to open, Python attempts to locate the file in the cur¬ 
rent directory. 



1 # Fig. 14.6: figl4_06.py 

2 # Reading and printing a file. 

3 

4 import sys 

5 

6 # open file 

7 try : 

8 file = open( , ) 

9 except IOError: 

10 print » sys.stderr, 

11 sys.exit ( ) 

12 

13 records = file.readlines() 

14 

15 print .ljust( ), 

16 print .ljust( ), 

17 print .rjust( ) 

18 


Fig. 14.6 Data read from a sequential-access file. (Part 1 of 2.) 
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19 

for record in records: 

# format each line 

20 

fields = record.split() 


21 

print fields[ ].ljust( 

) , 

22 

print fields[ ].ljust( 

) , 

23 

24 

print fields[ ].rjust( 

) 

25 

file.close() 



Account 

Name 

Balance 

100 

Jones 

24.98 

200 

Doe 

345.67 

300 

White 

0.00 

400 

Stone 

-42.16 

500 

Rich 

224.62 


Fig. 14.6 Data read from a sequential-accessfile. (Part 2 of 2.) 




File objects are opened for reading by default, so the statement 


file = open( 


) 


also opens clients . dat for reading. 

Good Programming Practice 14.1 


A programmer should set a file to open for reading only (using "r ") ifthe contents of the file 
should not be modified. This prevents unintentional modifications ofafile ’s contents. This is 
an example ofthe principle ofleast privilege. 


Method readlines (line 13) reads the entire file contents of Fig. 14.3 into the pro- 
gram. This method returns a list of the lines in the file, which the program Stores in variable 
records. For each line (record) in the file, method split returns the words 
(fields) in the line as a list. Lines 19-23 output the fields. Methods 1 just and r just 
left- and right-justify the fields, respectively, to format the output. Method close (line 25) 
closes the file associated with the file object. 

Python version 2.2 contains additional features that enable the programmer to use a file 
object in a for statement. For example, line 19 in the above example could be replaced by: 


for record in file: 


in a program that uses Python 2.2. This technique reads one line of file at a time and as- 
signs the line to record. The program can process that line immediately. Iterating over 
the lines in a file in this manner can be more efficient than reading the contents of a large 
file with method readlines, which requires the program to wait for the entire file to be 
read into memory before any of the file’s contents can be processed. 

To retrieve data sequentially from a file, programs normally start from the beginning 
of the file and read all the data consecutively until the desired data is found. It sometimes 
is necessary to process a file sequentially several times (from the beginning of the file) 
during the execution of a program. File objects provide method seek for repositioning the 
file-position pointer (which contains the byte number of the next byte to be read from or 
written to the file). The statement 








file.seek( , ) 
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repositions the file-position pointer at the beginning of the file. The first argument seek 
takes is the offset , which is an integer value that specifies the location in the file as a number 
of bytes from the seek directiori of the file. The second (optional) argument is the seek di- 
rection, or location , from which the offset begins. The seek direction can be 0 (the default) 
for positioning relative to the beginning of a file, 1 for positioning relative to the current 
position in a file or 2 for positioning relative to the end of a file. Some examples of posi¬ 
tioning the file position pointer are 

# position to the nth byte of file 

# assumes seek direction is 0 

file.seek( n ) 

# position n bytes forward in file 

file.seek( n, ) 

# position n bytes backward from end of file 

file.seek ( -n, ) 

# position at end of file 

file.seek ( , ) 

File-object method teli returns the current location of the file-position pointer. The 
following statement assigns the current file-position pointer value to variable location 

location = file.teli() 

Figure 14.7 uses seek in a program that enables a credit manager to display the 
account information for customers with zero balances (i.e., customers who do not owe any 
money), credit balances (i.e., customers to whom the company owes money) and debit bal¬ 
ances (i.e., customers who owe the company money for goods and Services received in the 
past). The program displays a menu and allows the credit manager to enter one of three 
options to obtain credit information. Option 1 produces a list of accounts with zero balances 
(lines 56-57). Option 2 produces a list of accounts with credit balances (lines 58-59). 
Option 3 produces a list of accounts with debit balances (lines 60-61). Option 4 terminates 
the program execution (lines 62-63). Entering an invalid option causes the program to 
prompt the user to enter another choice (lines 64-65). 

Lines 52-77 process the request for each request that is not option 4. Method read- 
line (line 67) reads one line from the file and moves the file-position pointer to the next 
line in the file. When method readline has finished reading ali lines from the file (i.e., 
the program has reached the end of the file), readline returns the empty string (" ")■ 

Method split (line 71) unpacks each record to three variables —account, name 
and balance. The program calls function shouldDisplay (lines 18-29), which 
returns 1 (true), if a record should be displayed. If applicable, function outputLine 
(lines 32-36) displays the record fields. 


1 # Fig. 14.7: figl4_07.py 

2 # Credit inquiry program. 

3 


Fig. 14.7 Credit-inquiry program. (Parti of 3.) 
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4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 


) ) 


import sys 

# retrieve one user command 

def getRequest(): 

while : 

request = int( raw_input( 

if <= request <= 
break 

return request 


# determine if balance should be displayed, based on type 

def shouldDisplay( accountType, balance ): 


if accountType == and balance < : 

return 1 

elif accountType == and balance > 

return 


# credit balance 


# debit balance 


elif accountType == 

return 1 

else : return 


# print formatted balance data 

def outputLine( account, name, balance ): 

print account.ljust ( ), 

print name.ljust( ), 

print balance.rjust( ) 


# open file 
try : 

file = open( 
except IOError: 

print >> sys.stderr, 
sys.exit( ) 


and balance == 0 : # zero balance 


be op< 


print 'E 
print 
print '2 
print " 3 
print 


# process user request(s) 
while : 




request = getRequest() 






Fig. 14.7 Credit-inquiry program. (Part2 of 3.) 
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56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 
81 
82 


if request == 

print 

elif request == 

print 

elif request == 

print 

elif request == 

break 

else : # getRequest 

print "\nlnvalid 


# zero balances 

# credit balances 

# debit balances 

# exit loop 

should never let program reach here 


currentRecord = file.readline() 


# process each line 

while ( currentRecord != ): 

account, narae, balance = currentRecord.split() 
balance = float( balance ) 


if shouldDisplay( request, balance ): 

outputLine( account, name, str( balance ) ) 

currentRecord = file.readline() 

file.seek( , ) # move to beginning of file 

print nEnd 

file.close () 


# close file 


Enter request 

1 - List accounts with zero balances 

2 - List accounts with credit balances 

3 - List accounts with debit balances 

4 - End of run 


? 1 



Accounts 

with zero balances: 

300 

White 

o 

o 

? 2 



Accounts 

with credit 

balances: 

400 

Stone 

-42.16 

? 3 



Accounts 

with debit 

balances: 

100 

Jones 

24.98 

200 

Doe 

345.67 

500 

Rich 

224.62 

? 4 



End of run. 









Fig. 14.7 Credit-inquiryprogram. (Part3of 3.) 
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14.6 Updating SequentiaI-Access Files 

Data that is formatted and written to a sequential-access file (as shown in the previous sec- 
tions) cannot be modified without the risk of destroying other data in the file. For example, 
if the name “White” needs to be changed to “Williams," the old name cannot simply 
be overwritten. In Fig. 14.7, the record for White was written to the file as 

300 White 0.00 

If a user overwrites this record with the name “Williams,” the record appears as 

300 WilliamsOO 


The new last name contains three more characters than the original last name, so the char- 
acters beyond the second “i” in “Williams" overwrite the other characters in the line. 
The problem here is that in the formatted input/output model, fields (records) can vary in 
size. For example, 7, 14, -117, 2074 and 27383 are all integers and are stored in the same 
number of “raw data” bytes internally, but when these integers are output as formatted text 
(character sequences) to the screen or to a file, they become different-sized fields. There- 
fore, the formatted input/output model usually is not used to update records in place. 

Updating data in sequential-access files is possible, but it is awkward. For example, to 
make the preceding name change, the records before 300 White 0.00 in a sequential- 
access file could be copied to a separate file, the updated record could then be written to 
this file and the records after 300 White 0.00 could be copied to this file. However, this 
can be cumbersome, because it requires processing every record in the file to update one 
record. If many records are being updated in one pass of the file, then the effort this tech- 
nique requires would be unacceptable. 


14.7 Random-Access Files 

We have explained how to create sequential-access files and how to search through such 
files to locate particular information. However, sequential-access files are inappropriate for 
so-called “instant-access” applicatioris, in which a particular record of information must 
be located immediately. Popular instant-access applications include airline reservation Sys¬ 
tems, banking systems, point-of-sale systems, automated-teller machines (ATMs) and oth¬ 
er kinds of transaction-processing systems that require rapid access to specific data. The 
bank at which an individual keeps an account may have hundreds of thousands or even mil- 
lions of other customers; however, when that individual uses an ATM, the appropriate ac¬ 
count is checked for sufficient funds in seconds. Instant access is possible with random- 
access files (sometimes called direct-access files). Individual records of a random-access 
file can be accessed directly (and quickly) without searching through other records. 

As we discussed earlier in this chapter, Python does not impose structure on files, so 
applications that use random-access files must create the random-access capability. There 
are a variety of techniques for creating random-access files. Perhaps the simplest involves 
requiring that all records in a file be of uniform-fixed length. The use of fixed-length 
records enable a program to calculate (as a function of the record size and the record key) 
the exact location of any record in relation to the beginning of the file. We soon demon¬ 
strate how this facilitates immediate access to specific records, even in large files. 

Figure 14.8 presents a view of a random-access file composed of fixed-length records 
Each record is 100 bytes long. A random-access file is like a railroad train with many 
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100 100 100 100 100 100 

bytes bytes bytes bytes bytes bytes 







Fig. 14.8 Structure of a random-accessfile. 

cars—some empty, some with contents. Data can be inserted into a random-access file 
without destroying other data in the file. In addition, previously stored data can be updated 
or deleted without rewriting the entire file. In the following sections, we explain how to 
create a random-access file, enter data to that file, read the data, update the data and delete 
data that is no longer needed. 

14.8 Smulating a Random-Access File: The shelve Module 

Random-access file-processing programs rarely write a single field to a file. Often, these pro- 
grams write one record (or object) at a time. Random-access files can be created in other pro- 
gramming languages by defining a class that represents the record to be written to the file. In 
such programming languages, program that uses the class then reads and writes instances to 
a random-access file based on the size of the class (i.e., the number of bytes an instance of the 
class occupies). Python provides module shelve to simulate such behavior, so a program- 
mer does not need to write a new class. We use this module in the following examples. 
Consider the following problem statement for a credit-processing application: 

Create a transaction-processing program capable ofstoring a maximum of 100 fixed-length 
recordsfor a company that can have a maximum of 100 customers. Each record consists of 
an account number (that acts as a record key), a last nante, afirst name and a balance. The 
program can update an account, insert a new account, delete an account and list ali the 
account records in a file. 

The next several sections introduce the techniques necessary to create this credit-pro¬ 
cessing program. We can use module shelve to read and write records in a file. To 
accomplish this, we create shelve objects to represent the records. These objects have a 
dictionary interface—the record key accesses a record’s information. In our example, the 
record key is the account number, and the record value is a list that contains the customer’s 
last name, first name and account balance. 

14.9 WHting Data to a shelve File 

Figure 14.9 retrieves account information from the user and writes the data to the shelve 
file credit.dat. Line 9 opens the shelve file credit.dat using function 
shelve . open. This function resembles the Python function open used for opening reg- 
ular files. If the file does not exist, shelve function open creates the file. If an error oc- 
curs when opening the file, the function raises an IOError exception. 
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1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 


# Fig. 14.9: figl4_09.py 

# Writing to shelve file. 

import sys 
import shelve 

# open shelve file 
try: 

outCredit = shelve.open( ) 

except IOError: 

print » sys.stderr, 
sys.exit( ) 

print "Enter account number (1 to 100, 0 t 

# get account Information 
while : 

# get account information 

accountNumber = int( raw_input( 

) ) 


if < accountNumber <= 


print "Enter lastname, 

currentData = raw_input 



outCredit[ str( accountNumber ) ] = currentData.split() 


elif accountNumber == 

break 


outCredit.close() 


Enter account number (1 to 
? 37 

100, 0 to 

end input) 

Enter lastname, firstname, 

? Barker Doug 0.00 

balance 


Enter account number 
? 29 

Enter lastname, firstname, 

? Brown Nancy -24.54 

balance 


Enter account number 

? 96 

Enter lastname, firstname, 

? Stone Sam 34.98 

balance 


Enter account number 

? 88 


(continued on next page) 


Fig. 14.9 Data writtentoa shelve file. (Part 1 of 2.) 
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(continued from previous page) 

Enter lastname, firstname, 
? Smith Dave 258.34 

balance 


Enter account number 

? 33 

Enter lastname, firstname, 
? Dunn Stacey 314.33 

balance 


Enter account number 
? 0 




Fig. 14.9 Data written to a shelve file. (Part 2 of 2.) 


Lines 20-21 prompt the user for the account numbers in the range 1-100, inclusive. 
Line 28 writes data to the shelve file. The program manipulates the data in a shelve 
file through a dictionary interface. Each key in a shelve file must be a string; therefore, 
function str converts the integer value accountNumber to a string (line 28). Method 
split converts the user-entered data into a list, which is stored as the record key’s value 
(line 28). When the user enters 0 to indicate the end of data, the file object’ s close method 
closes the shelve file (line 33). 


14.10 Retrieving Data ftom a shelve File 


(«) 


In the previous section, we created a shelve file and wrote data to that file. In this section, 
we present a program (Fig. 14.10) that iterates through the file and prints each record. 


1 

# Fig. 14.10: figl4_10.py 


2 

# Reading shelve file. 


3 

4 

import sys 


5 

import shelve 


6 

7 

# print formatted credit data 


8 

def outputLine( account, aList ): 


9 

10 

print account.ljust( ), 


11 

print aList[ ].ljust( ), 


12 

print aList [ ].ljust( ), 


13 

print aList[ ].rjust( ) 


14 

15 

# open shelve file 


16 

try: 


17 

creditFile = shelve.open( 

) 

18 

except IOError: 


19 

print » sys.stderr, 


20 

sys.exit( ) 


21 

22 

print .ljust( ), 



Fig. 14.10 Data readfroma shelve file. (Part 1 of 2.) 
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23 print .ljust( ), 

24 print . 1just ( ) , 

25 print .rjust( ) 

26 

27 # display each account 

28 for accountNumber in creditFile.keys() : 

outputLine( accountNumber, creditFile[ accountNumber ] ) 

30 

31 creditFile.close() 






Account 

Last Name 

First Name 

Balance 

37 

Barker 

Doug 

0.00 

88 

Smith 

Dave 

258.34 

33 

Dunn 

Stacey 

314.33 

29 

Brown 

Nancy 

-24.54 

96 

Stone 

Sam 

34.98 


Fig. 14.10 Data readfroma shelve file. (Part 2 of 2.) 


Method keys returns a list of the record keys in the shelve file (line 28). A for 
loop iterates over this list and passes each record key and its value to function output¬ 
Line. Function outputLine (lines 8-13) prints the record key and its associated values. 


14.11 Example: A Transaction-Processing Program 


(«) 


We now develop a substantial transaction-processing program (Fig. 14.11) that uses a 
shelve file to achieve “instant-access” processing. The program maintains a bank’s ac¬ 
count information. Users of this program can update existing accounts, add new accounts, 
delete accounts and store formatted listings of all the current accounts in text files. 


1 

# Fig. 14.11: figl4_ll.py 


2 

# Reads shelve file, updates data 


3 

# already written to file, creates 

data 

4 

# to be placed in file and deletes 

data 

5 

# already in file. 


6 

7 

import sys 


8 

import shelve 


9 

10 

# prompt for input menu choice 


11 

def enterChoice(): 


12 

13 

print "\nEnter your choice" 


14 

print "1 - store a formatted tej 


15 

print 


16 

print "2 - update an account" 


17 

print "3 - 


18 

print "4 - delete an account" 


19 

print "5 - end program" 



Fig. 14.11 Bank-account program. (Part 1 of 4.) 
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20 

21 

22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 


while 1 : 

menuChoice 


int ( raw_input( 


) ) 


if not <= menuChoice <= 
print » sys.stderr, 

else : 

break 

return menuChoice 

# create formatted text file for printing 

def textFile( readFromFile ): 

# open text file 
try : 

outputFile = open( , 

except IOError: 

print » sys.stderr, 
sys.exit( ) 


print >> outputFile, 
print » outputFile, 
print » outputFile, 
print » outputFile, 


■ 1just ( ), 

• 1just( ), 

■ 1just ( ), 

.rjust ( ) 


# print shelve values to text file 

for key in readFromFile.keys () : 

print » outputFile, key.1just ( ), 

print » outputFile, readFromFile[ key ][ 
print » outputFile, readFromFile[ key ][ 
print » outputFile, readFromFile[ key ][ 

outputFile.close() 

# update account balance 

def updateRecord( updateFile ): 

account = getAccount( 


(«) 


].1just( 
].1just( 
].rjust( 


) , 
) , 


) 


if updateFile.has_key( account ): 

outputLine( account, updateFile[ account ] ) 

transaction = raw_input( 


# create temporary record to alter data 

tempRecord = updateFile[ account ] 
tempBalance = float( tempRecord[ ] ) 

tempBalance += float ( transaction ) 
tempBalance = % tempBalance 

tempRecord[ ] = tempBalance 






Fig. 14.11 Bank-account program. (Part 2 of 4.) 
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73 

74 

75 

76 

77 

78 

79 

80 
81 
82 

83 

84 

85 

86 

87 

88 

89 

90 

91 

92 

93 

94 

95 

96 

97 

98 

99 

100 
101 
102 

103 

104 

105 

106 

107 

108 

109 

110 
111 
112 

113 

114 

115 

116 

117 

118 

119 

120 
121 
122 

123 

124 

125 


# update record in shelve 

dei updateFile[ account ] 
updateFile[ account ] = tempRecord 
outputLine( account, updateFile[ account ] ) 

else : 

print » sys.stderr, , account, \ 


# create and insert new record 

def newRecordf insertlnFile ): 


account = getAccount( ) 

if not insertlnFile.has_key( account ): 

print "Enter lastname, firstname, balance" 

currentData = raw_input( ) 

insertlnFile[ account ] = currentData.split() 

else : 

print » sys.stderr, , account, 


# delete existing record 

def deleteRecord( deleteFromFile ): 


account = getAccount( 

if deleteFromFile.has_key( account ): 
dei deleteFromFile[ account ] 
print , account, 

else : 

print » sys.stderr, , account, 


) 



\ 


# output line of Client information 

def outputLine( account, record ): 

print account.ljust( ), 

print record[ ].ljust( ), 

print record[ ].ljust( ), 

print record[ ].rjust( ) 

# get account number from keyboard 

def getAccount( prompt ): 

while : 

account = raw_input( prompt + ) 

if <= int( account ) <= 

break 

return account 






Fig. 14.11 Bank-account program. (Part 3 of 4.) 
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126 # list of functions that correspond to user options 

127 options = [ textFile, updateRecord, newRecord, deleteRecord ] 

128 

129 # open shelve file 

130 try : 

131 creditFile = shelve.open ( ) 

132 except IOError: 

133 print >> sys.stderr, 

134 sys.exit( ) 

135 

136 # process user commands 

137 while : 

138 

139 choice = enterChoice() 

140 

141 if choice == 

142 break 

143 

144 options [ choice - ] ( creditFile ) 

145 

146 creditFile.close() 


Fig. 14.11 Bank-account program. (Part4of 4.) 

Execute the program in Fig. 14.9 to insert data in the file that is used in this transaction- 
processing program (Fig. 14.11). The transaction-processing program offers a user five 
options (1-5) with which to work in the program. Option 1 calls function textFile 
(lines 33-54), which Stores a formatted list of all the account information in a text file called 
print. txt. From this file, a user can print a list of account information. Function text¬ 
File takes a shelve file as an argument and uses the data in that shelve file to create 
the text file. Function outputLine (lines 108-113) outputs the data to file stdout. 
After a user chooses option 1, the file print. txt contains the following text: 


Account 

Last Name 

First Name 

Balance 

37 

Barker 

Doug 

0.00 

88 

Smith 

Dave 

258.54 

33 

Dunn 

Stacey 

314.33 

29 

Brown 

Nancy 

-24.54 

96 

Stone 

Sam 

34.98 


When a user selects option 2, the program calls function updateRecord (lines 57-80) 
to update an account. First, the function determines whether the record that the user specifies 
exists, because the function can update only existing records. If the record exists, it is read 
into variable tempRecord. Lines 69-70 convert the string representation of the account bal- 
ance to a floating-point value before manipulating its numerical value. Before updating a 
record in the shelve file, the program must delete the existing record for the specified 
account; keyword dei (line 75) deletes the current record. Line 76 updates the record by 
assigning the new record values to the corresponding account number (record key). The pro¬ 
gram then outputs the updated values. The following is a typical output for this option: 
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Enter 

account to 

update (1 - 100): 37 

37 

Barker 

Doug 0.00 

Enter 

charge (+) 

or payment (-): +87.99 

37 

Barker 

Doug 87.99 


Portability 1 

rip i4.i 


i Not ali Python platforms require the value ofa record to be deletedfrom a shelve file be- 
J fore updating that record. However, using dei to delete a record value before updating it, 
ensures that the update occurs properly across Python platforms. 


Option 3 calls function newRecord to enable a user to add a new account. This func- 
tion adds an account in the same manner as that of the program of Fig. 14.9. If the user 
enters an account number for an existing account, newRecord displays a message that the 
account exists and the program allows the user to select the next operation to perform. A 
typical output for option 3 is as follows: 







Enter new account number (1 - 100): 22 
Enter lastname, firstname, balance 
? Johnston Sarah 247.45 


Option 4 calls function deleteRecordto remove a record that is no longer needed. 
The program prompts the user to enter an account number. If the account number exists, 
the program uses keyword dei to delete that record from the shelve file, then displays 
a message to inform the user that the record has been deleted. However, if the account 
number does not exist, the program displays an error message. A typical output for option 


4 is as follows: 


Enter account to delete (1 - 100): 29 
Account # 29 deleted. 


Option 5 terminates the program. The main portion of the program (lines 127-146) 
creates a list of functions that correspond to the user-menu options (line 127). The program 
then opens the shelve file for the bank accounts and gets the user’s menu choice. 

Line 144 calls a function that corresponds with a user option. Recall that parentheses 
(()) are Python operators. When used in conjunction with the function name (e.g., text- 
File), the operator calls the function and passes any indicated arguments. Variable 
options holds a list of function names, so a statement such as 

options[ ]( creditFile ) 

invokes function textFile (the first function in the list) and passes creditFile as an 
argument. Statements like this avoid the need for long if/else statements that determine 
the user menu option and call the appropriate function. 
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Serialization, or pickling, converts complex object types, such as user-defined classes, to 
sets of bytes for storage or for transmission over a network. Pickling also is referred to as 
flattening or marshalling. Python provides both modules pickle and cPickle to per- 
form pickling. In this text we use cPickle, a module written in C, instead of the Python 
module pickle. We choose to use cPickle, because modules written in compiled lan- 
guages, such as C, execute faster than do interpreted languages such as Python. 
Figure 14.12 demonstrates pickling and storing a list in a file. 


Performance Tip 14.2 


Module cPickle executes more ejficienlly than does module pickle, because cPickle 
is implemented in C and compiled into native machine language on each platform. 






1 

# Fig. 14.12: figl4_12.py 


2 

# Opening and writing pickled object to file. 


3 



4 

5 

import sys, cPickle 


6 

# open file 


7 

try: 


8 

file = open( , ) 

file in write mode 

9 

except IOError, message: 

open failed 

10 

print >> sys.stderr, 

, message 

11 

sys.exit( ) 


12 



13 

print "Enter the user name, name and date of 


14 

print "Enter end-of-file to end input." 


15 



16 

inputList = [] 


17 



18 

while : 


19 



20 

try: 


21 

accountLine = raw_input( ) 

# get user entry 

22 

except EOFError: 


23 

break 

# user-entered EOF 

24 

else : 


25 

inputList.append( accountLine.split() ) 

# append entry 

26 



27 

cPickle.dump( inputList, file ) 

28 



29 

file.close () 


Enter the user name, name and date of birth. 


Enter end-of-file to end input. 


? 

mike Michael 4/3/60 


? 

joe Joseph 12/5/71 


? 

amy Amelia 7/10/80 


? 

jan Janice 8/18/74 


? 

A Z 



Fig. 14.12 Pickled object written to a file. 
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Line 8 opens user.dat, the file in which the pickled object resides. Variable 
inputList, initialized in line 16, is a list that contains the user-entered information to 
pickle. Lines 18-25 prompt the user to enter information and append the user’s entries to 
inputList. Function cPickle. dump (line 27) pickles inputList to the file. The 
first argument to dump is the object to pickle and the second argument is the file object that 
represents the file in which method dump will store the pickled object. The function con- 
verts inputList to a series of bytes and writes the stream to the file. Line 29 calls file 
object method close to close the file. 

A program can convert pickled data back to the original format by unpickling the data. 
Figure 14.13 demonstrates unpickling. This example uses the pickled file created by the 
program in Fig. 14.12. 

The program first opens file users.dat (lines 7-11). Function cPickle. load 
(line 13) unpickles the data in the file. The function takes as an argument a file object that 
contains a pickled object, converts the pickled object into a Python object and returns a ref- 
erence to the unpickled object. We assign this reference to variable records. The pro¬ 
gram then closes the file, because the file is no longer needed (line 14). The remainder of 
the program (lines 16-23) displays the unpickled data by iterating over the list of lists. 






1 

2 

3 

4 

5 

6 

7 

8 
9 


# Fig. 14.13: figl4_13.py 

# Reading and printing pickled object in a file. 

import sys, cPickle 

# open file 
try: 

file = open( , ) 

except IOError: 


10 

print 

>> sys.stderr, 


11 

sys.exit( ) 



12 





13 

records = 

= cPickle 

.load( file ) 

# 

14 

file.close() 



15 





16 

print 


ljust( ), 


17 

print 

■ 1just( ), 


18 

print 


.rjust( 

) 

19 





20 

for record in records: 

# 

21 

print 

record[ 

] .1just ( 

) , 

22 

print 

record[ 

] .1just ( 

) , 

23 

print 

record[ 

] .rjust ( 

) 


# retrieve list of lines in file 


Username 

Name 

Date of birth 

mike 

Michael 

4/3/60 

joe 

Joseph 

12/5/71 

amy 

Amelia 

7/10/80 

jan 

Janice 

8/18/74 


Fig. 14.13 Pickled object read from a file. 
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SUMMARY 

• Files are used for long-term retention of large amounts of data. 

• Computers store files on secondary storage devices, such as magnetic disks, optical disks and tapes. 

• Ultimately, all data items processed by digital computers are reduced to combinations of zeros and 
ones. This occurs because it is simple and economical to build electronic devices that can assume 
two stable States— 0 represents one state, and 1 represents the other. 

• The smallest data item that computers support is called a bit (short for “binary digit'’—a digit that 
can assume one of two values). Each data item, or bit can assume either the value 0 or the value 1. 

• It is preferable to program with data forms such as decimal digits (e.g., 0. 1, 2, 3, 4, 5, 6, 7, 8 and 
9), letters (e.g., A through Z and a through z) and special symbols (e.g., $, @, %, &, *, (,), -, +, “, 
:, ?, /, etc.). 

• Digits, letters and special symbols are referred to as characters. 

• The set of all characters used to write programs and represent data items on a particular computer 
is called that computer’s character set. 

• Because computers can process only ls and Os, every character in a computer’s character set is 
represented as a sequence of ls and Os (called a byte). Bytes are composed of eight bits. 

• Just as characters are composed of bits, fields are composed of characters (or bytes). A field is a 
group of characters that convey a meaning. 

• Data items processed by computers form a data hierarchy in which data items become larger and 
more complex in structure in the progression from bits, to characters (bytes), to fields and up to 
larger data structures. 

• A record, which we can implement as a tuple, a dictionary or instance in Python, is a group of re- 
lated fields. 

• To facilitate the retrieval of specific records from a file, at least one field in each record is chosen 
as a record key. A record key identifies a record as belonging to a particular person or entity and 
distinguishes that record from all other records in the file. 

• There are many ways to organize records in a file. In the most common organization is a sequential 
file, in which records typically are stored in order by the record-key field. 

• Sometimes, a group of related files is called a database. 

• A collection of programs designed to create and manage databases is called a database manage- 
ment system (DBMS). 

• Python views each file as a sequential stream of bytes. 

• Python imposes no structure on a file—notions like “records” do not exist in Python files. 

• Each file ends either with an end-of-file marker or at a specific byte number recorded in a system- 
maintained administrative data structure. 

• When a file is opened, Python creates an object and associates a stream with that object. 

• Python creates three file streams— sys . stdin (Standard input stream), sys . stdout (Standard 
output stream) and sys . stderr (Standard error stream). These streams provide communication 
channels between a program and a particular file or device. 

• A program must import the sys module to access the three file streams directly. 

• Program input corresponds to sys . stdin. Function raw_input uses sys . stdin to get in¬ 
put from the user. 

• Program output corresponds with sys . stdout. By default, the print statement sends infor- 
mation to the Standard output stream. 
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• Program errors are printed to sys . stderr. 

• Function open, which takes one required argument and two optional arguments, creates a new 
stream objects. The required argument, for the new stream object, is the file name; the two optional 
arguments are the file open mode and the buffering mode. 

• The file open mode specifies whether the file should be opened for reading, writing or both. 

• The file open mode "w" opens a file to output data to the file; the file open mode "w+" opens a 
file to append data to the end of the file (without modifying any data already in the file). 

• Existing files opened with mode "w" are truncated—all data in the file is deleted. If the specified 
file does not yet exist, then a file is created. The newly created file is assigned the name provided 
in the file-name argument. 

• The default file-open mode is " r " , which opens a file for reading. 

• The third argument to function open—the buffering-mode argument—is for advanced control of 
file input and output and usually is not specified. 

• When open encounters an error, the function raises an IOError exception. 

• Programs can redirect output from the print statement to print to a different file object. 

• When the >> Symbol follows the print, print redirects output to the file object that appears to 
the right of ». A comma follows the output file object; the value to be printed follows the comma. 

• Function sys . exit terminates a program and returns its optional argument to the environment 
from which the program was invoked. Argument value 0 (the default) indicates normal program 
termination. Any other value indicates that the program terminated due to an error. The calling en¬ 
vironment can use the value retumed by sys . exit to respond appropriately to the error. 

• Invoking methods read. readline, readlines and xreadlines on the end-of-file char¬ 
acter raises an EOFError exception. 

• Method close closes a file object. Although Python closes open files when a program terminates, 
it is good practice to close a file explicitly as soon as the program no longer needs the file. 

• Data is stored in files so that they can be retrieved for processing. 

• Method readlines reads an entire file into a program. 

• Methods 1 just and r just left-and right-justify fields, respectively. 

• To retrieve data sequentially from a file, programs normally start reading from the beginning of 
the file, and read all the data consecutively until the desired data is found. 

• Method seek repositions the file position pointer. The first argument to seek is an offset, which 
is an integer value that specifies the location in the file as a number of bytes from the seek direc- 
tion. The second (optional) argument is a seek direction, or location, from which the offset begins. 

• File-object method teli returns the current location of the file-position pointer. 

• Method readline reads one line from the file. This method returns one line from the file and 
moves the file-position pointer to the next line in the file. When the file contains no more lines 
(i.e., the program has reached the end of the file), readline returns the empty string (" ")• 

• In the formatted input/output model, fields—and hence records—can vary in size. Therefore, the 
formatted input/output model usually is not used to update records. 

• Sequential-access files are inappropriate for so-called “instant-access” applications in which a par- 
ticular record of information must be located immediately. 

• Individual records of a random-access file can be accessed directly (and quickly) without search- 
ing through other records. Random-access files sometimes are called direct-access files. 

• Data can be inserted into a random-access file without destroying other data in the file. In addition, 
previously stored data can be updated or deleted without rewriting the entire file. 
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• Module shelve reads and writes objects to a random-access file. 

• A program can create shelve file objects to represent records. These objects have a dictionary 
interface—the record key accesses a record’s information. 

• The shelve . open function resembles the Python function open that opens regular files. 

• Method keys returns a list of the record keys in the shelve file. 

• Serialization, or pickling, converts complex object types, such as programmer-defined classes, to 
sets of bytes for storage or for transmission over a network. Pickling also is referred to as flattening 
or marshalling. 

• Python provides both modules pickle and Pickle to perform pickling. 

• Module cPickle, which is implemented in C, executes much faster than does module pickle, 
which is implemented in Python. Modules written in compiled languages, such as C, execute faster 
than do interpreted languages such as Python. 

• Function cPickle . dump pickles objects. 

• Unpickling restores a pickled object to its original form. 

• Function cPickle . load unpickles pickled objects in a file. 






TERMINOLOGY 

» Symbol 
"a" file-open mode 
"ab" file-open mode 
bit 

buffering mode 
byte 

character set 
close method 
cPickle method 
data hierarchy 
database 

database management system (DBMS) 

end-of-file marker 

EOFError exception 

field 

file 

file name 
file-open mode 
file-position pointer 
file-seek location 
instant-access processing 
IOError exception 
keys method 
magnetic disk 
offset 

open method 
persistent data 
pickling an object 
random-access file 


raw data processing 
readline method 
readlines method 
record 
record key 
redirection of output 
"r" file-open mode 
"r+" file-open mode 
" r+b " file-open mode 
"rb" file-open mode 
seek method 
sequential-access file 
serialization 
shelve file 
shelve module 
split method 

standard-error stream (sys . stderr) 
standard-input stream (sys . stdin) 
standard-output stream (sys . stdout) 
stream 

sys . exit function 
teli method 

transaction-processing systems 
truncate 

unpickling an object 
"w" file-open mode 
"w+" file-open mode 
"w+b" file-open mode 
"wb" file-open mode 
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SELF-REVIEW EXERCISES 


14.1 


14.2 


Fili in the blanks in each of the foliowing statements: 

a) Computers store files on_, such as magnetic disks. 

b) A record can be implemented as a_, a_or a_in Python. 

c) The set of all characters used to write programs on a computer is called its_. 

d) In a_, records typically are stored in order by the record key. 

e) Python creates three file streams—_,_and_. 

f) A_is composed of several fields. 

g) To facilitate the retrieval of specific records from a file, one field in each record is chosen 

as a_. 

h) At the lowest level, the functions performed by computers essentially involve the manip- 

ulation of_and_. 

i) Data items represented in computers form a_, in which data items become 

larger and more complex as they progress from bits to fields. 

j) A group of related files is called a_. 


State which of the following are true and which axe fcilse. If false, explain why. 

a) The programmer must create the sys . stderr stream explicitly. 

b) The smallest data item in a computer is a byte. 

c) Python views each file as a dictionary. 

d) File streams serve as communication channels. 

e) It is not necessary to search through all the records in a random-access file to find a spe¬ 
cific record. 

f) Records in random-access files must be of uniform length. 

g) Module cPickle performs more efficiently than does module pickle because 
cPickle is written in Python. 

h) Serialization converts complex objects to a set of bytes. 

i) Method sys . exit retums 1 by default to signify that no errors occurred. 

j) Sequential-access files are inappropriate for instant-access applications in which records 
must be located quickly. 


ANSWERS TO SELF-REVIEW EXERCISES 

14.1 a) secondary storage devices. b) tuple, dictionary, instance. c) character set. d) random-ac¬ 
cess file, e) sys . stdout, sys . stdin, sys . stderr. f) record. g) record key. h) 0’s, l’s. 
i) data hierarchy. j) database. 

14.2 a) False. This stream is created for the programmer. b) False. The smallest data item in a 
computer is a bit. c) False. Python views each file as a stream. d) True. e) True. f) False. Records in 
random-access files normally are of uniform length, but are not required to be so. g) False. Module 
cPickle performs more efficiently because it is written in C and compiled into native machine lan- 
guage for each platform. h) True. i) False. Method sys . exit retums 0 by default to signify that no 
errors occurred. j) True. 


EXERCISES 

14.3 Fili in the blanks in each of the following statements: 

a) A group of related characters that conveys meaning is called a_. 

b) Method_repositions the file-position pointer in a file. 

c) Programs can_output from the print statement to print to a different file object. 

d) If the user enters the end-of-file character, function raw_input raises an_. 

e) Method_retums a list of the lines in a file. 
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14.4 State which of the following are true and which axe false. If false, explain why. 

a) People prefer to manipulate bits instead of charactere and fields because bits are more 
compact. 

b) People specify programs and data items as charactere; computers then manipulate and 
process these charactere as groups of zeros and ones. 

c) Most organizations store all Information in a single file to facilitate computer processing. 

d) Each statement that processes a file in a Python program explicitly refers to that file by 
name. 

e) Python imposes no structure on a file. 

14.5 You are the owner of a hardware store and need to keep an inventory that can teli you what 
different tools you have, how many of each you have on hand and the cost of each one. Write a pro¬ 
gram that initializes the shelve file "hardware . dat", lets you input the data concerning each 
tool and enables you to list all your tools. The tool Identification number should be the record number. 
Use the following information to start your file: 

14.6 Modify the inventory program of Exercise 14.5. The modified program allows you to delete 
a record for a tool that you no longer have and allows you to update any information in the file. 

14.7 Create a simple text editor GUI that allows the user to open a file. The GUI should display 
the text of the file and then close the file. The user can modify the file’s contents. When the user 
chooses to save the text, the modified contents should be written to the file, replacing any other con¬ 
tents. The user also should be able to ciear the display. 

14.8 Create four band members from the class BandMember. Pickle these objects and store them 
in a file. Unpickle, then output the objects. 


Record Number 

Tool name 

Quantity 

Cost 

17 

Hammer 

76 

11.99 

37 

Saw 

88 

12.00 

68 

Screwdriver 

106 

6.99 

83 

Wrench 

34 

7.50 


Fig. 14.14 Data for Exercise 14.5. 



1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 


class BandMember: 


def _ init_( self, name, instrument ): 


self.name = name 

self.instrument = instrument 

def _ str_( self ): 


return 


self.name, self.instrument ) 








Fig. 14.15 Class BandMember. 


































pythonhtpl_15.fm Page 491 Saturday, December 15, 2001 2:12 PM 






Extensible Markup 
Language (XML) 


mv 


Objectives 

• To understand XML. 

• To mark up data using XML. 

• To become familiar with the types of markup 
languages created with XML. 

• To understand the relationships among DTDs, 
Schemas and XML. 

• To understand the fundamentals of DOM-based and 
SAX-based parsing. 

• To understand the concept of XML namespaces. 

• To create simple XSLT documents. 

Every country has its own language, yet the subjects ofwhich 
the untutored soul speaks are the same everywhere. 
Tertullian 

The chief merit of language is clearness, and we know that 
nothing detracts so muchfrom this as do unfamiliar ternis. 
Galen 

Like everything metaphysical, the harmony bet\i’een thought 
and reality is to befound in the grammar ofthe language. 
Ludwig Wittgenstein 




■m 
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Outiine 

15.1 Introduction 

15.2 XML Documents 

15.3 XMLNamespaces 

15.4 DocumentObjectModel (DOM) 

15.5 Simple API for XML (SAX) 

15.6 Documentlype Definitions (DTDs), Schemasand Validation 

15.6.1 Documentlype Definition Documents 

15.6.2 W3C XML Schema Documents 

15.7 XML Vocabula ries 

15.7.1 MathML" 

15.7.2 Chemical Maikup Language (CML) 

15.7.3 OtherXMLVocabularies 

15.8 Extensible Stylesheet Language (XSL) 

15.9 Internet and World Wfde Web Resources 

Summary • Terminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 


15.1 Introduction 

The Extensible Markup Language (XML) was developed in 1996 by the World Wide Web 
Consortium’s (W3C’s) XML Working Group. XML is a portable, widely supported, open 
technology (i.e., non-proprietary technology) for describing data. XML quickly is becom- 
ing the Standard for data that is exchanged between applications. Using XML, document 
authors can describe any type of data, including mathematical formulas, Software configu- 
ration instructions, music, recipes and financial reports. An additional benefit of using 
XML is that documents are readable by both humans and machines. 

This chapter explores XML and various XML-related technologies. The first three sec- 
tions introduce XML and how it is used to mark up data. The next two sections describe 
two different programmatic libraries that can be used to manipulate XML documents. Later 
sections introduce several XML vocabularies (i.e., markup languages created with XML). 
This chapter also examines a technology called Extensible Stylesheet Language Transfor- 
mations (XSLT), which transforms XML data into other text-based formats. Chapter 16, 
Python XML Processing, builds upon the concepts presented in this chapter by writing 
Python applications that use XML. 

15.2 XML Documents 

Our first XML document describes an article (Fig. 15.1). [Note: Every XML document we 
show has line numbers for the reader’s convenience. These line numbers are not part of the 
XML documents.] 

This document begins with an optional XML declaration (line 1), which identifies the 
document as an XML document. The version informationparameter specifies the version 
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1 <?xml version = 1.0 ?> 

2 

3 <!-- Fig. 15.1: article.xml --> 

4 <!-- Article structured with XML. --> 

5 

6 <article> 

7 

8 <title>Simple XML</title> 

9 

10 <date>December 21, 2001</date> 

11 

12 <author> 

13 <firstName> John</f irstName> 

14 <lastName>Doe</lastName> 

15 </author> 

16 

17 <summary:XML is pretty easy. </summary> 

18 

19 <content>In this chapter, we present a wide variety of examples 

20 that use XML. 

21 </content> 

22 

23 </article> 


Fig. 15.1 XMLused to markup an article. 

of XML 1 that is used in the document. XML comments (lines 3—4j begin with < ! - - and end 
with - - and can be placed almost any where in an XML document. As in a Python program, 
comments are used in XML for documentation purposes. 

Common Programming Error 15.1 

Placing any characters, including whitespace, before the XML declaration is an error. 




Portability Tip 15.1 

Although the XML declaration is optional, documents should include the declaration to iden- 
tify the version ofXML used. Otherwise , in the future, a document that lacks an XML decla¬ 
ration might be assumed to conform to the latest version ofXML, and errors could resuit. 


XML marks up data using tags, which are names enclosed in angle brackets (< >). Tags 
are used in pairs to delimit character data (e.g.. Simple XML). A tag that begins markup 
(i.e., XML data) is called a start tag , whereas a tag that terminates markup is called an end 
tag. Examples of start tags are <article> and <title> (lines 6 and 8, respectively). 
End tags differ from start tags in that they contain a forward slash (/) character immediately 
after the < character. Examples of end tags are </title> and </article> (lines 8 and 
23, respectively). XML documents can contain any number of tags. 



Common Programming Error 15.2 


Failure to provide a corresponding end tag for a start tag is an error. 






1. Currently, there is only one version of XML, 1.0. 
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Individual units of markup (i.e., everything included between a start tag and its corre- 
sponding end tag) are called elements. An XML document includes one element (called a 
root element ) that contains all other elements in the document. The root element must be 
the first element after the XML declaration. In Fig. 15.1, article (line 6) is the root ele¬ 
ment. Elements are nested to form hierarchies—with the root element at the top of the hier- 
archy. This allows document authors to create explicit relationships between data. For 
example, elements title, date, author, summary and content then are nested 
within article. Elements f irstName and lastName are nested within author. 


Common Programming Error 15.3 



Attempting to create more than one root element in an XML document is an error. 


Element title (line 8) contains the title of the article. Simple XML, as character 
data. Similarly, date (line 10), summary (line 17) and content (lines 19-21) contain 
character data that represent the article’s publication date, summary and content, respec- 
tively. XML tag names can be of any length and may contain letters, digits, underscores, 
hyphens and periods—they must begin with a letter or an underscore. 


.Common Programming Error 15.4 



XML is case sensitive. Using the wrong case for an XML tag name is an error. 


By itself, this document is simply a text file named article. xml. Although it is not 
required, most XML-document file names end with the file extension .xmlr Processing 
an XML document requires a program called an XML parser. Parsers are responsible for 
checking an XML document’s syntax and making the XML document’s data available to 
applications. Often, XML parsers are built into applications or available for download over 
the Internet. Popular parsers include Microsoft’s msxml , 4DOM (a Python package that we 
use extensively in the Chapter 16), the Apache Software Foundation’s Xerces and IBM’s 
XML4J. In this chapter, we use msxml. 

When the user loads article .xml into Internet Explorer (IE), msxml parses the 
document and passes the parsed data to IE. IE then uses a built-in style sheet to format the 
data. Notice that the resulting format of the data (Fig. 15.2) is similar to the format of the 
XML document shown in Fig. 15.1. As we soon demonstrate, style sheets play an important 
and powerful role in the transformation of XML data into formats suitable for display. 

Notice the minus (—) and plus (+) signs in Fig. 15.2. Although these are not part of the 
XML document, IE places them next to all Container elements (i.e., elements that contain 
other elements). Container elements also are called parent elements. A minus sign indicates 
that the parent element’s child elements (i.e., nested elements) currently are displayed. When 
clicked, a minus sign becomes a plus sign (which collapses the Container element and hides 
all of its children). Conversely, clicking a plus sign expands the Container element and 
changes the plus sign to a minus sign. This behavior is similar to the viewing of the directory 
structure on a Windows system using Windows Explorer. In fact, a directory structure often 
is modeled as a series of tree structures, in which each drive letter (e.g., C:, etc.) represents 


2. Some applications that process XML documents may require this file extension. 

3. IE 5 and higher. 
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Minus sign 



Plussign 


Fig. 15.2 article. xml displayed by Internet Explorer. 


the root of a tree. Each folder is a node in the tree. Parsers often place XML data into trees to 
facilitate efficient manipulation, as discussed in Section 15.4. 


.Common Programming Error 15.5 



Nesting XML tags improperly is an error. For example, <xxy>hello</xx/y> is an 
error, because the </y> tag must precede the </x> tag. 


We now present a second XML document (Lig. 15.3), which marks up a business letter. 
This document contains significantly more data than did the previous XML document. 


1 <?xml version = " 1 . 0 "?> 

2 

3 <!-- Fig. 15.3: letter.xml 

4 <1 — Business letter formatted with XML. --> 

5 








Fig. 15.3 Business letter marked up as XML. (Part 1 of 2.) 

























































pythonhtpl_15.fm Page 496 Saturday, December 15, 2001 2:12 PM 




496 Extensible Markup Language (XML) 


Chapter 15 






6 

<letter> 


7 

ccontact type = coir > 


8 

<name>Jane Doe</name> 


9 

<addressl>Box 12345</addressl> 


10 

<address2>15 Any Ave. </address2> 


11 

<city>Othertown< /city> 


12 

<state>Otherstate</state> 


13 

<zip>67890</zip> 


14 

<phone>555-4321</phone> 


15 

<flag gender = /> 


16 

</contact> 


17 



18 

ccontact type = > 


19 

<name>John Doe</name> 


20 

<addressl>123 Main St. </addressl> 


21 

<address2 ></address2> 


22 

<city>Anytown</city> 


23 

<state>Anystate</state> 


24 

<zip>12345</zip> 


25 

<phone>555-1234</phone> 


26 

<flag gender = /> 


27 

</contact> 


28 



29 

<saluta tion>Dear Sir:</salutation> 


30 



31 

<paragraph>It is our privilege to inform 

you about our new 

32 

database managed with <technology>XML</technology> . This 

33 

new system allows you to reduce the load 

on 

34 

your inventory list server by having the 

Client machine 

35 

perform the work of sorting and filtering the data. 

36 

</paragraph> 


37 



38 

<paragraph>Please visit our Web site for 

availability 

39 

and pricing. 


40 

</paragraph> 


41 



42 

<closing>Sincerely</closing> 


43 



44 

<signature>Ms . Doe</signature> 


45 

</letter> 



Fig. 15.3 Business lettermarked up as XML. (Part 2 of 2.) 


Root element letter (lines 6-45) contains the child elements contact (lines 7-16 
and 18-27), salutation, paragraph, closing and signature. In addition to 
being placed between tags, data also can be placed in attributes, which are name-value pairs 
in start tags. Elements can have any number of attributes in their start tags. The first con¬ 
tact element (lines 7-16) has attribute type with attribute value "from", which indi- 
cates that this contact element marks up information about the letter’s sender. The 
second contact element (lines 18-27) has attribute type with value "to", which indi- 
cates that this contact element marks up information about the letter’s recipient. Like tag 
names, attribute names are case sensitive; can be any length; may contain letters, digits, 
underscores, hyphens and periods; and must begin with either a letter or underscore char- 
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acter. A contact element Stores a contact’s name, address and phone number. Element 
salutation (line 29) marks up the letter’s salutation. Lines 31-40 mark up the letter’s 
body with paragraph elements. Elements closing (line 42) and signature (line 
44) mark up the closing sentence and the signature of the letter’s author, respectively. 


Common Programming Error 15.6 



Failure to enclose attribute values in double (" ") or single {' ') quotes is an error. 


In line 15, we introduce empty element f lag, which indicates the gender of the con¬ 
tact. Empty elements do not contain character data (i.e., they do not contain text between 
the start and end tags). Such elements are closed either by placing a slash at the end of the 
element (as shown in line 15) or by explicitly writing a closing tag, as in 


<flag gender = ></flag> 


15.3 XMLNamespaces 

Languages such as Python provide massive class libraries that group their features into 
namespaces. These namespaces prevent naming collisions between programmer-defined 
identifiers and identifiers in class libraries. For example, we might use class Book to repre- 
sent information on one of our publications; however, a stamp collector might use class Book 
to represent a book of stamps. Without using namespaces to differentiate the two Book class¬ 
es, a naming collision would occur if we use these two classes in the same application. 

Like Python, XML also provides namespaces for unique Identification of XML ele¬ 
ments. In addition, XML-based languages—called vocabularies, such as XML Schema 
(Section 15.6) and the Extensible Stylesheet Language (Section 15.8)—often use 
namespaces to identify their elements. 

Namespace prefixes, which identify the namespace to which an element belongs, dif¬ 
ferentiate elements. For example. 


<deitel:publication> 

Python How to Program 
</deitel:publication> 


qualifies element publication with namespace prefix deitel. This indicates that el¬ 
ement publication is part of namespace deitel. Document authors can use any 
name for a namespace prefix except the reserved namespace prefix xml. 


Common Programming Error 15.7 



Attempting to create a namespace prefix named xml in any combination ofuppercase and low- 
ercase letters is an enor. 


The markup in Fig. 15.4 demonstrates the use of namespaces. This XML document 
contains two file elements that are differentiated using namespaces. 


1 <?xml version = 1.0"?> 

2 

3 <!-- Fig. 15.4: namespace.xml --> 

4 <!-- Demonstrating namespaces. --> 


Fig. 15.4 XMLnamespacesdemonstration. (Part 1 of 2.) 
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5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 


<text:directory xmlns:text = "http://www.deitel.com/ns/pyt: 
xmlns:image = 'http://www.deitel.com/images/ns/120101"> 

<text:file filename = book > 

<text: description>A book list</text :description> 
</text:file> 


<image:file filename = 'funny.jpc > 

<image: description>A funny picture</image :description> 
<image:size width = '200" height = ^00' /> 

</image:file> 

</text:directory> 




Fig. 15.4 XMLnamespacesdemonstration. (Part 2 of 2.) 



Attributes need not be qualified with namespace prefixes, because they always are associated 
with elements. 


Lines 6-7 use attribute xmlns to create two namespace prefixes: text and image. 
Each namespace prefix is bound to a series of characters called a uniform resource identi- 
fier (URI) that uniquely identifies the namespace. Document authors create their own 
namespace prefixes and URIs. 

To ensure that namespaces are unique, document authors must provide unique URIs. 
Here, we use the text http://www.deitel.com/ns/pythonle and http:// 
www.deitel. com/images/ns/120101 as URIs. A common practice is to use Uni¬ 
ve rsal Resource Locators (URLs) for URIs, because the domain names (such as, 
www.deitel. com) used in URLs are guaranteed to be unique. In this example, we use 
URLs related to the Deitel & Associates, Inc., domain name to identify namespaces. The 
parser never visits these URLs—they simply represent a series of characters used to differ¬ 
entiate names. The URLs need not refer to actual Web pages or be formed properly. 
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Lines 9-11 use the namespace prefix text to describe elements file and descrip¬ 
tiori. Notice that the namespace prefix text is applied to the end tag name as well. Lines 
13-16 apply namespace prefix image to elements file, descriptiori and size. 

To eliminate the need to precede each tag name with a namespace prefix, document 
authors can specify a default namespace. Figure 15.5 demonstrates the creation and use of 
default namespaces. 

Line 6 defines a default namespace by binding a URI to attribute xmlns. Once this 
default namespace is defined, tag names in child elements belonging to the namespace need 
not be qualified by a namespace prefix. Element file (line 9-11) is in the namespace cor- 
responding to the URI http : / /www. deitel. com/ns/pythonie. Compare this to 
lines 9-11 of Fig. 15.4, where we prefixed elements file and description with text. 

The default namespace applies to element directory and all elements that are not 
qualified with a namespace prefix. However, we can use a namespace prefix to specify a 
different namespace for particular elements. For example, line 13 prefixes tag name file 




1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 


<?xml version = '1.0"?> 


<!-- Fig. 15.5: defaultnamespace.xml --> 

<!-- Using default namespaces. --> 

<directory xmlns = "http://www.deitel.com/ns 
xmlns:image = "http://www.deitel.com/imag 

<file filename = book > 

<description>A book list</description> 
</file> 


> 



<image:file filename = 1 funny.jpg 1 > 

cimage: description>A funny picture</image :description> 
<image:size width = height = /> 

</image:file> 

</directory> 







Fig. 15.5 Default namespace demonstration. 
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in with image to indicate that it is in the namespace corresponding to the URI http: // 
www. deitel. com/images/ns/12 0101, rather than in the default namespace. 

15.4 Document Object Model (DOM) 

Although XML documents are text files, retrieving data from them via sequential-file ac- 
cess techniques is neither practical nor efficient, especially in situations where data must be 
added or deleted dynamically. 

Upon successful parsing of documents, some XML parsers store document data as tree 
structures in memory. Figure 15.6 illustrates the tree structure for the document 
article.xml discussed in Fig. 15.1. This hierarchical tree structure is called a Docu- 
ment Object Model (DOM) tree, and an XML parser that creates this type of structure is 
known as a DOM parser. The DOM tree represents each component of the XML document 
(e.g., article, date, f irstName, etc.) as anode in the tree. Nodes (such as, author) 
that contain other nodes (called child nodes ) are called parent nodes. Nodes that have the 
same parent (such as, f irstName and lastName) are called sibling nodes. A node’s 
descendant nodes include that node’s children, its children’s children and so on. Similarly, 
a node’s ancestor nodes include that node’s parent, its parent’s parent and so on. 

The DOM has a single root node , called the document root, which contains ali other 
nodes in a document. For example, the root node for article. xml (Fig. 15.1) contains 
a node for the XML declaration (line 1), two nodes for the comments (lines 3—4) and a node 
for the root element (line 6). 

Each node is an object that has attributes and methods. Attributes associated with a 
node include tag names, values, child nodes, etc. Methods enable programs to create, delete 
and append nodes, load XML documents and so on. The XML parser exposes these 
methods as a programmatic library—called an Application Programming Interjace (API). 
We discuss how to use the DOM API in Chapter 16, Python XML Processing. 

15.5 Simple API for XML (SAX) 

Members of the XML-DEV mailing list developed the Simple API for XML (SAX), which 
they released in May, 1998. SAX is an alternate method for parsing XML documents that 



Fig. 15.6 Tree structure for article. xml. 
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uses an event-based model — SAX-basedparsers generate notifications called events as the 
parser processes the document. Software programs can “listen” for these events to retrieve 
data from the document. For example, a program that builds mailing lists might read name 
and address information from an XML document that contains much more than just mailing 
address information (e.g., birthdays, phone numbers, email addresses, etc.). Such a pro¬ 
gram could use a SAX parser to parse the document, and might listen only for events that 
contain name and address information. SAX-based parsers are available for a variety of 
programming languages such as Python, Java and C++. We demonstrate SAX-based pars- 
ing in Chapter 16, Python XML Processing. 

SAX and DOM provide dramatically different APIs for accessing XML document 
data. Each API has advantages and disadvantages. DOM is a tree-based model that Stores 
the document’s data in a hierarchy of nodes. Programs can access data quickly, because all 
the document’s data is in memory. DOM also provides facilities for adding or removing 
nodes, which enables programs to modify XML documents easily. 

SAX-based parsers invoke listener methods when the parser encounters markup. With 
this event-based model, the SAX-based parser does not create a tree structure to store the 
XML document’s data—instead, the parser passes data to the application from the XML 
document as the parser finds that data. This results in greater performance and less memory 
overhead than with DOM-based parsers. In fact, many DOM parsers use SAX parsers 
“under the hood” to retrieve data from a document for building the DOM tree in memory. 
Many programmers find it easier to traverse and manipulate XML documents using the 
DOM tree structure. As a resuit, programs typically use SAX parsers for reading XML doc¬ 
uments that the program will not modify. 

Performance Tip 15.1 


SAX-based parsing often is more efficient than DOM-based parsing for processing large 
XML documents — SAX-based parsers do not load entire XML documents into memory. 

Performance Tip 15.2 


SAX-based parsing is an efficient means of parsing documents that only need parsing once. 



Performance Tip 15.3 

DOM-based parsing often is more efficient than SAX-based parsing when a program must 
retrieve specific information from the document quickly. 



Performance Tip 15.4 

Programs that must conserve memory commonly use SAX-based parsers. 



Members ofthe XML-DEV mailing list developed SAX independently ofthe W3C, although 
SAX has wide industry support. DOM is the official W3C recommendation. 


15.6 Documentlype Definitioris (DTDs), Schemasand 
Validation 

This section introduces Document Type Definitioris (DTDs) and Schemas —documents that 
specify the structure of XML documents (i.e., what elements are permitted, what attributes an 
element can have and so on). When a DTD or Schema document is provided, some parsers 
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(called validcitingparsers 4 ) read the DTD or Schema and check the XML document’s struc¬ 
ture against it. If the XML document conforms to the DTD or Schema, then the XML docu- 
ment is valid. Parsers that cannot validate documents against DTDs or Schemas are called 
non-validating parsers. If an XML parser (validating or non-validating) is able to process an 
XML document (that does not reference a DTD or Schema), the XML document is consid- 
ered to be wellformed (i.e., it is syntactically correct). By definition, a valid XML document 
is a well-formed XML document. If a document is not well formed, the parser issues an error. 



DTD and Schema documents are essential components for XML documents used in business- 
to-business (B2B) transactions and mission-critical systems. 



Because XML document content can be structured in many different ways, an application 
cannot determine whether the document data it receives is complete, missing data or ordered 
properly. DTDs and Schemas solve this problem by providing an extensible means of de- 
scribing a document's contents. An application can use a DTD or Schema document to per- 
form a validity check on the document’s contents. 


15.6.1 Doc ument Type Definition Documents 


Document type definitions (DTDs) provide a means for type checking XML documents and 
thus verifying their validity (confirming that elements contain the proper attributes, elements 
are in the proper sequence, etc.). DTDs use EBNF (Extended Backus-Naur Form) grammar 
to describe an XML document’s content. XML parsers need additional functionality to read 
EBNF grammar, because it is not XML syntax. Although DTDs are optional, they are recom- 
mended to ensure document conformity. The DTD in Fig. 15.7 defines the set of rules (i.e., 
the grammar) for structuring the business letter document contained in Fig. 15.8. 


1 

<!- - Fig. 

15.7: letter.dtd 

- - > 

2 

■3 

<!-- DTD document for letter. 

.xml. - - > 

«J 

4 

<!ELEMENT 

letter ( contact+. 

salutation, paragraph+. 

5 

6 

7 

closing, signature ) > 


<!ELEMENT 

contact ( name, addressl, address2, city, state. 

8 

zip, phone, flag ) > 


9 

<!ATTLIST 

contact type CDATA 

#IMPLIED> 

10 




11 

<!ELEMENT 

name ( #PCDATA ) > 


12 

<!ELEMENT 

addressl ( #PCDATA 

) > 

13 

<!ELEMENT 

address2 ( #PCDATA 

) > 

14 

<!ELEMENT 

City ( #PCDATA ) > 


15 

<!ELEMENT 

state ( #PCDATA )> 


16 

<!ELEMENT 

zip ( #PCDATA ) > 


17 

<!ELEMENT 

phone ( #PCDATA ) > 



Fig. 15.7 Document Type Definition (DTD) fora business letter. (Part 1 of 2.) 


4. Many DOM parsers and SAX parsers are validating parsers. Check you parser's documentadon to 
determine whether it is a validating parser. 
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18 

<!ELEMENT 

19 

<!ATTLIST 

20 


21 

<!ELEMENT 

22 

<!ELEMENT 

23 

<!ELEMENT 

24 

<!ELEMENT 


flag EMPTY> 

flag gender (M | F) 

salutation ( ttPCDATA ) > 
closing ( #PCDATA ) > 
paragraph ( #PCDATA ) > 
signature ( #PCDATA ) > 


Fig. 15.7 DocumentType Definition (DTD) fora business letter. (Part 2 of 2.) 



Portability Tip 15.2 

DTDs can ensure consistency among XML documents generated by different programs. 


Line 4 uses the ELEMENT element type declaration to define rules for element 
letter. In this case, letter contains one or more contact elements, one saluta¬ 
tion element, one or more paragraph elements, one closing element and one sig¬ 
nature element, in that sequence. The plus sign (+) occurrence indicator specifies that 
an element must occur one or more times. Other indicators include the asterisk (*), which 
indicates an optional element that can occur any number of times, and the question mark 
(?), which indicates an optional element that can occur at most once. If an occurrence indi¬ 
cator is omitted, exactly one occurrence is expected. 

The contact element definition (line 7) specifies that it contains the name, 
addressl, address2, ci ty, state, zip, phone and flag elements—in that order. 
Exactly one occurrence of each is expected. 

Line 9 uses the ATTLIST element type declaration to define an attribute (i.e., type) 
for the contact element. Keyword #IMPLIED specifies that, if the parser finds a con¬ 
tact element without a type attribute, the application can provide a value or ignore the 
missing attribute. The absence of a type attribute cannot invalidate the document. Other 
types of default values include #REQUIRED and #FIXED. Keyword #REQUIRED speci¬ 
fies that the attribute must be present in the document and the keyword #FIXED specifies 
that the attribute (if present) must always be assigned a specific value. For example. 


<!attlist address zip #FIXED "01757"> 


indicates that the value 01757 must be used for attribute zip; otherwise, the document is 
invalid. If the attribute is not present, then the parser, by default, uses the fixed value that is 
specified in the ATTLIST declaration. Flag CDATA specifies that attribute type contains 
text that is not processed by the parser, but instead is passed to the application as is. 



DTD syntax cannot describe an element's (or attribute’s) data type. 


Flag #PCDATA (line 11) specifies that the element can store parsed character data (i.e., 
text). Parsed character data cannot contain markup. Because they are used in markup, the 
characters less than (<) and ampersand (&) must be replaced by their entity references (i.e., 
&lt; and &amp;). However, the ampersand character can be used with entity references. 
See Appendix M, HTML/XHTML Special Characters, for a list of pre-defined entities. 

Line 18 defines an empty element named flag. Keyword EMPTY specifies that the ele¬ 
ment cannot contain character data. Empty elements commonly are used for their attributes. 
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Common Programming Error 15.8 


Any element, attribute or relationship not explicitly defined by a DTD results in an invalid 
document. 


XML documents must reference a DTD explicitly. Figure 15.8 is an XML document 
that conforms to letter. dtd (Fig. 15.7). 







1 

7 

<?xml version = "1.0' ?> 


3 

<!-- Fig. 15.8: letter2.xml --> 


4 

c 

<!-- Business letter formatted with XML. --> 


6 

7 

<!DOCTYPE letter SYSTEM > 


8 

<letter> 


9 

ccontact type = roir > 


10 

<name>Jane Doe</name> 


11 

<addressl>Box 12345</addressl> 


12 

<address2>15 Any Ave. </address2> 


13 

<city>Othertown< /city> 


14 

<state>Otherstate</state> 


15 

<zip>67890</zip> 


16 

<phone>555-4321</phone> 


17 

<flag gender = /> 


18 

</contact> 


19 



20 

<contact type = ;o"> 


21 

<name>John Doe</name> 


22 

<addressl>123 Main St. </addressl> 


23 

<address2 ></address2> 


24 

<city>Anytown</city> 


25 

<state>Anystate< /state> 


26 

<zip>12345</zip> 


27 

<phone>555-1234</phone> 


28 

<flag gender = /> 


29 

</contact> 


30 



31 

<saluta tion>Dear Sir:</salutation> 


32 



33 

<paragraph>It is our privilege to inform you about our new 

34 

database managed with XML. This new System 


35 

allows you to reduce the load on your inventory 

list 

36 

server by having the Client machine perform the 

work of 

37 

sorting and filtering the data. 


38 

</paragraph> 


39 



40 

<paragraph>Please visit our Web site for availability 

41 

and pricing. 


42 

</paragraph> 


43 

<closing>Sincerely</closing> 


44 

<signature>Ms . Doe</signature> 


45 

</letter> 



Fig. 15.8 XMLdocumentreferencing itsassociated DTD. 
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This XML document is similar to that in Fig. 15.3. Line 6 references a DTD file. This 
markup contains three pieces: The name of the root element (letter in line 8) to which 
the DTD is applied, the keyword SYSTEM (which in this case denotes an external DTD — 
a DTD defined in a separate file) and the DTD’s name and location (i.e., letter. dtd in 
the current directory). Though almost any file extension can be used, DTD documents typ- 
ically end with the . dtd extension. 

Various tools (many of which are free) check document conformity against DTDs and 
Schemas (discussed momentarily). The output in Fig. 15.9 shows the results of validating 
letter2 .xml against letter. dtd using Microsoft’s XML Validator. Microsoft XML 
Validator is available free for download from msdn.microsoft.com/downloads/ 
samples/Internet/xml/xml_validator/sample.asp. For additional valida- 
tion tools, visit www. w3 . org/XML/Schema. html. 




XML DOM Test Page - Microsoft Internet Explorer 


JsJxi 



fepone rrra My Computer 








Fig. 15.9 XML Validator validating an XMLdocumentagainsta DTD. 
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The Microsoft XML Validator can validate XML documents against DTDs locally or 
by uploading the documents to the XML Validator Web site. Here, letter2 .xml and 
letter . dtd are placed in folder /pythonhtpl/pythonhtpl_examples/Chl5. 
This XML document (letter2 .xml) is valid because it conforms to letter. dtd. 

XML documents that fail validation stili may be well-formed documents. When a docu¬ 
ment fails to conform to a DTD or Schema, Microsoft XML Validator displays an error mes- 
sage. For example, the DTD in Fig. 15.8 indicates that the contacts element must contain 
child element name. If this element is omitted, the document is well formed, but not valid. In 
such a scenario, Microsoft XML Validator displays the error message shown in Fig. 15.10. 

15.6.2 W3C XML Schema Documents 

This section introduces W3C XML Schema 5 —a W3C Recommendation (i.e., a stable re- 
lease suitable for use in industry). Many developers in the XML community believe DTDs 
are not flexible enough to meet today’s programming needs. For example, programs cannot 
manipulate DTDs (e.g., search, transform into different representations such as XHTML, 
etc.) in the same manner as XML documents because DTDs are not themselves XML doc¬ 
uments. These and other limitations led to the development of Schemas. 

Unlike DTDs, Schemas do not use EBNF grammar. Instead, Schemas use XML syntax 
and are actually XML documents that can be manipulated programmatically. Like DTDs, 
Schemas require validating parsers. In the near future, Schemas likely will replace DTDs 
as the primary means of describing XML document structure. 

A DTD describes an XML document’s structure, not the content of that document’s 
elements. For example, 

<quantity>5</quantity> 

contains character data. If the document containing element quanti ty references a DTD, 
an XML parser can validate the document to confirm that this element indeed does contain 
PCDATA content, but the parser cannot validate whether the content is numeric; DTDs do 
not provide such capability. So, unfortunately, the parser also considers markup such as 

<quantity>hello</quantity> 



Fig. 15.10 XMLValidatordisplaying an eirormessage. 


5. For the latest information on W3C XML Schema, visit www. w3 . org/XML/Schema. 
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to be valid. The application that uses the XML document containing this markup would 
need to test whether the data in element quantity is numeric and take appropriate action 
if the data is not numerics. 

XML Schema enables Schema authors to specify that element quantity’s data must 
be numeric. When a parser validates the XML document against this Schema, the parser 
can determine that 5 conforms and that hello does not. An XML document that conforms 
to a schema document is schema valid and a document that does not conform is invalid. 

In this section, we use XSV (XML Schema Validator) to validate XML documents against 
W3C XML Schema. To use XSV Online, visit www. w3 . org/2 00 0/09/webdata/xsv, 
enter the name of the XML file to validate, then press the Upload and Get ResultS button. 
Visit www. ltg. ed. ac .uk/~ht/xsv-status . html to download XSV. 



Many organizations and individuals are creating DTDs and schemas for a broad range of 
applications (e.g., financial transactions, medical prescriptions, etc.). These collections — 
called repositories —often are available free for download from the Web (e.g., 

www. dtd. com). 


Figure 15.11 shows a Schema-valid XML document (book.xml) and Fig. 15.12 shows 
the W3C XML Schema document (book.xsd) that defines the structure for book.xml. 
W3C XML Schemas typically use the .xsd extension, although this is not required. 
Figure 15.11 shows the resuit of validating book.xml against Schema book.xsd. Note 
that the output is XML, and the outcome= 1 success 1 and schemaErrors= 1 0 1 
attributes indicate that book. xml is valid. 

W3C XML Schema use the namespace URI http://www.w3 . org/2001/ 
XMLSchema and often use namespace prefix xsd (line 6 in Fig. 15.12). Root element 
schema contains elements that define an XML document’s structure. Line 7 binds the URI 
http : / /www. dei tel. com/booklist to namespace prefix deitel. Line 8 speci- 
fies the targetNamespace, which is the namespace for elements and attributes that this 
Schema defines. 



Good Programming Practice 15.1 

By convention, W3C XML Schema authors use namespace prefix xsd when referring to the 

URI http: //www. w3 . org/2001/XMLSchema.\ 


1 <?xml version = "1.0 ?> 

2 

3 <!-- Fig. 15.11: book.xml --> 

4 <!-- Document that conforms to a W3C XML Schema. --> 

5 

6 <deitel:books xmlns:deitel = "http://www.deitel.ct clist"> 

7 <book> 

<title>e-Business and e-Commerce How to Program</title> 

9 </book> 

10 <book> 

11 <title>Python How to Program</title> 

12 </book> 

13 </deitel:books> 


Fig. 15.11 XMLdocumentthatconformsto a W3C XMLSchema. (Part lof 2.) 
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C:\Program Files\XSV>xsv /pythonhtpl_examples/chl5/Schema/book.xml / 
pythonhtplexamples/chl5/Schema/book.xsd 

<?xml version= 1 1.0'?> 

<xsv docElt= 1 {http://www.deitel.com/booklist}books 1 

instanceAssessed= 1 true' instanceErrors= 1 0 1 rootType= 1 {http://www.dei- 
tel.com/booklist}:BooksType 1 schemaDocs= 1 /pythonhtpl examples/chl5/ 
Schema/book.xsd 1 schemaErrors='0' target= 1 file:/pythonhtpl examples/ 
chl5/Schema/book.xml 1 validation= 1 striet 1 version='XSV 1.203.2.37/ 
1.106.2.19 of 2001/11/29 11:00:00■xmlns='http://www.w3.org/2000/05/ 
xsv 1 > 

<schemaDocAttempt URI= 1 file:/pythonhtpl_examples/chl5/Schema/ 
book.xsd' outcome= 1 success 1 source= 1 command line'/> 

</xsv> 


Fig. 15.11 XMLdocumentthat conformsto a W3C XMLSchema. (Part 2 of 2.) 







1 

<?xml version = "1.0'?> 



2 




3 

<!-- Fig. 15.12: book.xsd --> 



4 

<!-- Simple W3C XML Schema document. --> 



5 




6 

<xsd:schema xmlns:xsd = "http://www.w3.org/2001, 



7 

xmlns:deitel = "http://www.deitel.com/bookli: 



8 

targetNamespace = "http://www.deitel.com/bool 

clist"> 


9 




10 

<xsd:element name = "books" type = 'deit 


/> 

11 




12 

<xsd:complexType name = "BooksTyp > 



13 

<xsd:sequence> 



14 

<xsd:element name = book" type = "dei? 



15 

minOccurs = maxOccurs = nboun< 

ied" /> 


16 

</xsd:sequence> 



17 

</xsd:complexType> 



18 




19 

<xsd:complexType name = "BookTy > 



20 

<xsd:sequence> 



21 

<xsd:element name = "title" type = 'xs< 


/> 

22 

</xsd:sequence> 



23 

</xsd:complexType> 



24 




25 

</xsd:schema> 




Fig. 15.12 XSD Schema documentto which book.xml conforms. 


In W3C XML Schema, element element (line 10) defines an element. Attributes 
name and type specify the element’s name and data type, respectively. In this case, the 
name of the element is books and the data type is deitel: BooksType. Any element 
(e.g., books) that contains attributes or child elements must define a complex type, which 
defines each attribute and child element. Type deitel:BooksType (lines 12-17) is an 
example of a complex type. We prefix BooksType with deitel, because this is a com¬ 
plex type that we have created, not an existing W3C XML Schema data type. 
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Lines 12-17 use element complexType to define an element type that has a child 
element named book. Because book contains a child element, its type must be a complex 
type (e.g., BookType). Attribute minOccurs specifies that books must contain a min¬ 
imum of one book element. Attribute maxOccurs , with value unbounded (line 14) 
specifies that books may have any number of book child elements. Element sequence 
specifies the order of elements in the complex type. 

Lines 19-23 define the complexType BookType. Line 21 defines element title 
with type xsd: string. When an element has a simple type such as xsd: string, it 
is prohibited from containing attributes and child elements. W3C XML Schema provides a 
large number of data types such as xsd: date for dates, xsd: int for integers, 
xsd: double for floating-point numbers and xsd: time for time. 

The Schema in Fig. 15.12 indicates that every book element must contain child ele¬ 
ment title. If this element is omitted, the document is well formed, but not valid. If we 
remove line 8 from Fig. 15.11, XSV displays the error message shown in Fig. 15.13. 


15.7 XML Vocabula lies 


XML allows document authors to create their own tags to describe data precisely. People 
and organizations in various fields of study have created many different XML vocabularies 
for structuring data. Some of these vocabularies are: MathML (Mathematical Markup Lan¬ 
guage), Scalable Vector Graphics (SVG), Wireless Markup Language ( WML ), Extensible 
Business Reporting Language ( XBRL ), Extensible User Interface Language (XUL ) and 
VoiceXML™. Two other examples of XML vocabularies are W3C XML Schema and the 


C:\PROGRA~l\XSV>xsv /pythonhtpl/pythonhtplexamples/Chl5/Schema/ 
book.xml /pythonhtpl/pythonhtplexamples/Chi5/Schema/book.xsd 

<?xml version= 1 1.0'?> 

<xsv docElt= 1 {http://www.deitel.com/booklist}books 1 instanceAs- 
sessed='true' instanceErrors= 1 1' rootType= 1 {http://www.deitel.com/ 
booklist}:BooksType' schemaDocs= 1 /pythonhtpl/pythonhtplexamples/ 
Chl5/Schema/book.xsd 1 schemaErrors=■0 1 target= 1 file:/pythonhtpl/ 
pythonhtpl_examples/Chl5/Schema/book.xml 1 validation= 1 striet' ver- 
sion= 1 XSV 1.203.2.37/1.106.2.19 of 2001/11/29 11:00:00' xmlns= 1 http:// 
www.w3.org/2000/05/xsv'> 

<schemaDocAttempt URI= 1 file:/pythonhtpl/pythonhtpl_examples/Chl5/ 
Schema/book.xsd' outcome= 1 success 1 source= 1 command line'/> 
cinvalid char= 1 4 1 code= 1 eve-complex-type.1.2.4 1 line= 1 8 1 re- 
source='file:/pythonhtpl/pythonhtpl_examples/Chi5/Schema/ 
book.xml 1 >content of book is not allowed to end here (1), expecting 
[ 1 {None}:title 1 ]: 

<f sm> 

enode id='l'> 

<edge dest='2' label= 1 {None}:title'/> 

</node> 

enode final='true' id='2'/> 

e/fsm>e/invalid> 

e/xsv> 








Fig. 15.13 XMLdocumentthatdoesnotconform to a W3C XMLSchema. 
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Extensible Stylesheet Language (XSL), which is introduced in Section 15.8. The following 
subsections describe MathML, Chemical Markup Language (CML) and other XML vocab- 
ularies. 

15.7.1 MathML™ 

Until recently, computers typically required specialized Software packages such as TeX 
and LaTeX to display complex mathematical expressions. This section introduces Math¬ 
ML, which the W3C developed for describing mathematical notations and expressions. 
One application that can parse and render MathML is the W3C’s Amaya™ browser/editor, 
which can be downloaded at no charge from 

www.w3.org/Amaya/User/BinDist.html 

This Web page contains download links for the Windows 95/98/NT/2000, Linux® and So- 

TM 

laris platforms. Amaya documentation and installation notes also are available at the 
W3C Web site. 

MathML markup describes mathematical expressions for display. Ligure 15.14 uses 
MathML to mark up a simple expression. [Note: In this section, we provide sample outputs 
that illustrate how a MathML-enabled application might render the markup.] 








1 

<?xml version= ' 1.0" ?> 


2 



3 

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitio 


4 

"http://www.w3.org/TR/xhtmll/DTD/xhtmll-transition 

al.dtd > 

5 



6 

<!-- Fig. 15.14: mathmll.html --> 


7 

<!-- Simple MathML. --> 


8 



9 

<html xmlns = "http://www.w3.org/1999/xhtml"> 


10 



11 

<headxtitle>Simple MathML Example</titlex/head> 


12 



13 

<body> 


14 



15 

<math xmlns = "http://www.w3.org/1998/Math/MathM 

> 

16 



17 

<mrow> 


18 

<mn>2</mn> 


19 

<mo>+</mo> 


20 

<mn>3</mn> 


21 

<mo>=</mo> 


22 

<mn>5</mn> 


23 

</mrow> 


24 



25 

</math> 


26 



27 

</body> 


28 

</html> 



Fig. 15.14 Expression marked up with MathML (Part 1 of 2.) 
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(2 + 3 = 5 ) 

Fig. 15.14 Expressiori marked up with MathML (Part 2 of 2.) 

We embed the MathML content into an XHTML document by using a math element 
with the default namespace http: / /www .w3 . org/19 98/Math/MathML (line 15). 
The mrow element (line 17) is a Container element for expressions that contain more than 
one element. In this case, the mrow element contains five children. The mn element (line 
18) marks up a number. The mo element (line 19) marks up an operator (e.g., +). Using this 
markup, we define the expression 2 + 3 = 5, which a Software program that supports 
MathML could display. 

Let us now consider using MathML to mark up an algebraic equation that uses expo- 
nents and arithmetic operators (Fig. 15.15). 




1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 


<?xml version= ?> 

<!DOCTYPE html PUBLIC 


<!-- Fig. 15.15: mathml2.html --> 

<!-- Simple MathML. --> 

<html xmlns = "http://www.w3.org/1999/xhtml"> 

<headxtitle>Algebraic MathML Example</titlex/head> 
<body> 

<math xmlns = "http://www.w3.org/1998/Math/MathML"> 

<mrow> 

<mrow> 

<mn>3</mn> 

<mo>&InvisibleTimes; </mo> 

<msup> 

<mi>x</mi> 

<mn>2</mn> 

</msup> 

</mrow> 

<mo>+</mo> 

<mi>x</mi> 

<mo>-</mo> 

<mfrac> 

<mn>2</mn> 

<mi>x</mi> 

</mfrac> 









Fig. 15.15 Algebraic equation marked up with MathML (Part 1 of 2.) 
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37 

38 <mo>=</mo> 

39 <mn>0</mn> 

40 

41 </mrow> 

42 </math> 

43 

44 </body> 

45 </html> 


3x 2 + x - - = 0 

X 


Fig. 15.15 Algebraic equation marked up with MathML (Part 2 of 2.) 


Element mrow behaves like parentheses, which allow the document author to group 
related elements properly. Line 20 uses entity reference &InvisibleTimes ; to indicate a 
multiplication operation without a symbolic representalion (i.e., the multiplication Symbol 
does not appear between the 3 and x). For exponentiation, line 22 uses the msup element, 
which represents a superscript. This msup element has two children—the expression to be 
superscripted (i.e., the base) and the superscript (i.e., the exponent). Similarly, the msub ele¬ 
ment represents a subscript. To display variables such as x, line 23 uses identifier element mi. 

To display a fraction, line 33 uses element mfrac. Lines 34-35 specify the numerator 
and the denominator for the fraction. If either the numerator or the denominator contains 
more than one element, it must be nested in an mrow element. 

Figure 15.16 marks up a calculus expression that contains an integral Symbol and a 
square-root Symbol. 


1 

<?xml version= . 0 "?> 



2 




3 

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML ] 



4 



> 

5 




6 

<!-- Fig. 15.16: mathml3.html --> 



7 

<!-- Calculus example using MathML. --> 



8 




9 

<html xmlns = "http://www.w3.org/1999/xhti 

> 


10 




11 

<headxtitle>Calculus MathML Example</titlex/head> 


12 




13 

<body> 



14 




15 

cmath xmlns = "http://www.w3.org/19! 

) 8 /Math/MathML 11 > 


16 

<mrow> 



17 

<msubsup> 



18 




19 

<mo>&Integral; </mo> 



20 

<mn>0</mn> 




Fig. 15.16 Calculus expression marked up with MathML (Part 1 of 2.) 
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21 



22 

<mrow> 


23 

<mn>l</mn> 


24 

<mo>-</mo> 


25 

<mi >y</mi> 


26 

</mrow> 


27 



28 

</msubsup> 


29 



30 

<msqrt> 


31 

<mrow> 


32 



33 

<mn>4</mn> 


34 

<mo>&InvisibleTimes; </mo> 


35 



36 

<msup> 


37 

<mi>x</mi> 


38 

<mn>2</mn> 


39 

</msup> 


40 



41 

<mo>+</mo> 


42 

<mi >y</mi> 


43 



44 

</mrow> 


45 

</msqrt> 


46 



47 

<mo>&delta; </mo> 


48 

<mi>x</mi> 


49 

</mrow> 


50 

</math> 


51 

</body> 


52 

</html> 



Integra^ _ ^ f 1 “ 5^ J 4x 2 + y§X 

Delta 

/mbol 


Symbol J Q J | 




Fig. 15.16 Calculusexpnession marked up with MathML (Part 2 of 2.) 


The entity reference &Integral ; (line 19) represents the integral Symbol, while the 
msubsup element (line 17) specifies the superscript and subscript. Element mo marks up 
the integral operator. Element msubsup requires three child elements—an operator (e.g., 
the integral entity reference), the subscript expression (line 20) and the superscript expres- 
sion (lines 22-26). Element mn (line 20) marks up the number (i.e., 0) that represents the 
subscript. Element mrow marks up the expression (i.e., 1 -y) that specifies the superscript 
expression 

Element msqrt (lines 30-45) represents a square root expression. Line 31 uses ele¬ 
ment mrow to group the expression contained in the square root. Line 47 introduces entity 
reference &delta; for representing a delta Symbol. Delta is an operator, so line 47 places 
this entity reference in element mo. To see other operations and symbols in MathML, visit 

www.w3.org/Math. 
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15.7.2 Chemical Maikup Language (CML) 

Chemical Markup Language (CML) is an XML vocabulary for representing molecular and 
Chemical information. Although many of our readers will not know the chemistry required 
to understand the example in this section fully, we feel that CML so beautifully illustrates 
the purpose of XML that we chose to include the example for the readers who wish to see 
XML “at its best.” Document authors can edit and view CML, using the Jumho browser°, 
which is available at www.xml-cml.org. Figure 15.17 shows an ammonia molecule 
marked up in CML. 

Lines 1-2 contain a processing instructiori (PI ), which contains application-specific 
information embedded in an XML document. The characters <? and ?> delimit a pro¬ 
cessing instruction. The processing instruction of lines 1-2 provides application-specific 
information to the Jumbo browser. Processing instructions consist of a PI target (e.g.. 




1 

<?jumboinamespace ns = "http: 




2 

prefix = "C" java = 


?> 


3 





4 

<!-- Fig. 15.17: ammonia.xml 




5 

<!-- Structure of ammonia. 

- - > 



6 





7 

<C:molecule id = aon: > 




8 





9 

<C:atomArray builtin = "ei 

.sym” > 



10 

N H H H 




11 

</C:atomArray> 




12 





13 

<C:atomArray builtin = 

!" type = 

at" > 


14 

1.5 0.0 1.5 3.0 




15 

</C:atomArray> 




16 





17 

<C:atomArray builtin = "y' 

type = 

at"> 


18 

1.5 1.5 0.0 1.5 




19 

</C:atomArray> 




20 





21 

<C:bondArray builtin = "at 

:idl" > 



22 

111 




23 

</C:bondArray> 




24 





25 

<C:bondArray builtin = "at 

;id2 " > 



26 

2 3 4 




27 

</C:bondArray> 




28 





29 

<C:bondArray builtin = "oi 

type = 


> 

30 

111 




31 

</C:bondArray> 




32 





33 

</C:molecule> 





Fig. 15.17 CML markup for ammonia molecule. (Part 1 of 2.) 



6. At the time of this writing, Jumbo did not allow users to load documents for rendering. For illus- 
tration purposes, we created the image shown in Fig. 15.17. 
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Ammonia 







Fig. 15.17 C ML markup for ammonia molecule. (Part 2 of 2.) 

jumbo : namespace) and a PI value (e.g., ns = "http://www.xml-cml.org" 
prefix = "C" java= " jumbo . cmlxml. *Node"). 

, r v, Portability Tip 15.3 

a jul m Processing instructioris allow document authors to embed application-specific information 
in an XML document, without affecting that document’s portability. 

Line 7 defines an ammonia molecule using element molecule. Attribute id identi- 
fies this molecule as Ammonia. Lines 9-11 use element atomArray and attribute 
builtin to specify the molecule’s atoms. Ammonia contains one nitrogen atom and three 
hydrogen atoms. 

Lines 13-15 show element atomArray with attribute builtin assigned the value 
x2 and type float. This specifies that the element contains a list of floating-point num- 
bers, each of which indicates the x-coordinate of an atom. The first value (1.5) is the x- 
coordinate of the first atom (nitrogen), the second value (0.0) is the x-coordinate of the 
second atom (the first hydrogen atom) and so on. 

Lines 17-19 show element atomArray with attribute builtin assigned the value 
y2 and type float. This specifies that the element contains a list of y-coordinate values. 
The first value (1.5) is the y-coordinate of the first atom (nitrogen), the second value 
(1.5) is the y-coordinate of the second atom (the first hydrogen atom) and so on. 

Lines 21-23 show element bondArray with attribute builtin assigned the value 
atidl. Element bondArray defines the bonds between atoms. This element has a 
builtin value of atidl, so the values this element specifies compose the first atom in 
a pair of atoms. We are defining three bonds, so we specify three values. For each value, 
we specify the first atom in the atomArray, the nitrogen atom. 

Lines 25-27 show element bondArray with attribute builtin assigned the value 
atid2. The values of this element compose the second atom in a pair of atoms and denote 
the three hydrogen atoms. 

Lines 29-31 show element bondArray with the attribute builtin assigned the 
value order and type integer. The values of this element are integers that represent 
the number of bonds between the pairs of atoms. Thus, the bond between the nitrogen atom 
and the first hydrogen is a single bond, the bond between the nitrogen atom and the second 
hydrogen atom is a single bond, and the bond between the nitrogen atom and the third 
hydrogen atom is a single bond. 
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15.7.3 Other XML Vocabularies 

Literally hundreds of XML vocabularies derive from XML. Every day, developers find 
new uses for XML. In Fig. 15.18, we summarize some of these vocabularies. 

15.8 Extensible Stylesheet Language (XSL) 7 8 

Extensible Stylesheet Language (XSL) is an XML vocabulary for formatting XML data. In 
this section, we discuss the portion of XSL—called XSL Transformations (XSLT )—that 
creates formatted text-based documents from XML documents. This process is called a 
transformation and involves two tree structures—the source tree , which is the XML docu- 
ment being transformed, and the resuit tree, which is the resuit (e.g., Extensible Hypertext 

o 

Markup Language or XHTML ) of the transformation. The source tree is not modified 
when a transformation occurs. 







Vocabulary 

Desc ription 

VoiceXML™ 

The VoiceXML forum founded by AT&T, IBM, Lucent and Motorola 
developed VoiceXML. It provides interactive voice communication 
between humans and computers through a telephone, PDA (personal 
digital assistant) or desktop computer. IBM’s VoiceXML SDK can pro¬ 
cess VoiceXML documents. Visit www. voicexml. org for more 
information on VoiceXML. 

Synchronous 

Multimedia 

Integration 

Language (SMIL™) 

SMIL is an XML vocabulary for multimedia presentations. The W3C 
was the primary developer of SMIL, with contributions from other 
companies. Visit www. w3 . org/AudioVideo for more on SMIL. 

Research Information 
Exchange Markup 
Language (RIXML) 

RIXML, which a consortium of brokerage firms developed, marks up 
investment data. Visit www. rixml. org for more information on 
RIXML. 

ComicsML 

A language developed by Jason Macintosh for marking up comics. Visit 
www. jmac . org/pro j ects/comics ml for more information on 
ComicsML. 

Geography Markup 
Language (GML) 

The OpenGIS developed the GML to describe geographic information. 
Visit www. opengis . org for more information on GML. 

Extensible User 
Interface Language 
(XUL) 

The Mozilla project created XUL for describing graphical user inter- 
faces in a platform-independent way. For more information visit: 

www.mozilla.org/xpfe/languageSpec.html. 

Fig. 15.18 XMLVocabularies. 


7. The example in this section requires msxml 3.0 or higher to run. For more information on down- 
loading and installing msxml 3.0, visit www.deitel. com. 

8. XHTML is the W3C Recommendation that replaces HTML for marking up content for the Web. 
For more information on XHTML, see the XHTML Appendices I and J. 
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To perform transformations, an XSLT processor is required. Popular XSLT processors 
include Microsoft’s msxml, the Apache Software Foundation’ s Xalan 2 and the Python 
package 4 XSL T (which we use in Chapter 16, Python XML Processing). The XML docu- 
ment in Fig. 15.19 is transformed by msxml into an XHTML document using the XSLT 
document in Fig. 15.20. 

Line 6 is a processing instruction specific to IE that specifies the location of the XSLT 
document to apply to this XML document. Figure 15.20 presents the XSLT document 
(sorting.xsl) that transforms sorting.xml (Fig. 15.19) to XHTML. 



Performance Tip 15.5 

1 Using Internet Explorer on the client to process XSLT documents conserves ser\>er resources 
by using the client’s processing power (instead ofhaving the server process XSLT documents 
for multiple clients). 




1 

c?xml version = "1.0' ?> 


3 

<!-- Fig. 15.19: sorting.xml --> 


4 

c 

<!-- XML document containing book information. --> 


6 

7 

<?xml:stylesheet type = "text/xs href = "sorting.xs 

"?> 

8 

cbook isbn = "999-99999-9-X"> 


9 

ctitle>Mary&apos ;s XML Primer</title> 


10 



11 

<author> 


12 

<firstName>Mary</ firstName> 


13 

clastName >White</lastName> 


14 

</author> 


15 



16 

<chapters> 


17 

<frontMatter> 


18 

<preface pages = "2" /> 


19 

<contents pages = /> 


20 

cillustrations pages = /> 


21 

</frontMatter> 


22 



23 

cchapter number = 11 3" pages = 44 > 


24 

Advanced XML /chapter> 


25 

cchapter number = "2* pages = > 


26 

Intermediate XML</chapter> 


27 

cappendix number = pages = > 


28 

Parsers and Tools</appendix> 


29 

cappendix number = "A" pages = "7 > 


30 

Entities</appendix> 


31 

cchapter number = pages = 28 > 


32 

XML Fundamentalsc/chapter> 


33 

c/chapters> 


34 



35 

cmedia type = "CD' /> 


36 

c/book> 



(«) 






Fig. 15.19 XMLdocumentcontaining bookinformation. 
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Line 1 of Fig. 15.20 contains the XML declaration. This line is present because an 
XSLT document is an XML document. Line 6 is the xsl: stylesheet root element. 
Attribute ver sion speciftes the version of XSLT to which this document conforms. 
Namespace prefix xsl is defined and bound to the XSLT URI defined by the W3C. When 
processed, lines 11-13 write the document type declaration to the resuit tree. Attribute 
method is assigned "xml ", which indicates that XML is being output to the resuit tree. 
Attribute omit-xml -declaration is assigned "no", which indicates that an XML 
declaration will be output to the resuit tree. Attribute doc type - sys tem and doc type - 
public contain the Doctype DTD information that is output to the resuit tree. 




1 <?xml version = "1.0" ?> 

2 


3 

<!-- Fig. 15.20: sorting.xsl 

- - > 

4 

<!-- Transformation of book information into XHTML. --> 

5 



6 

<xsl:stylesheet version = 0' 


7 

xmlns:xsl = "http://www.w3.org/1999/XSI 

/Trans form" > 

8 



9 

<!-- write XML declaration and DOCTYPE 

DTD information --> 

10 

<xsl:output method = omit-xml-declaration = no" 

11 

doctype-system = 


12 



13 

doctype-public = "-//W3C//DTD XHTML 

1.0 Striet//EN"/ > 

14 



15 

<!-- match document root --> 


16 

<xsl:template match = "/' > 


17 

<html xmlns = "http://www.w3.org/199 

9/xhtml > 

18 

<xsl:apply-templates /> 


19 

</html> 


20 

</xsl:template> 


21 



22 

<!-- match book --> 


23 

<xsl:template match = "boo^ > 


24 

<head> 


25 

<title>ISBN <xsl:value-of select 

= /> - 

26 

<xsl:value-of select = itle" 

/></title> 

27 

</head> 


28 



29 

<body> 


30 

<hl style = 'color: blu > 


31 

<xsl:value-of select = itle" 

/></hl> 

32 



33 

<h2 style = " >by <xsl 

:value-of 

34 

select = />, 


35 

<xsl:value-of select = thor 

/></h2> 

36 



37 

ctable style = 


38 


und-color: wheat"> 




Fig. 15.20 XSLTdoc ument that tra nsforms sorting. xml into XHTML (Part 1 of 3.) 

































pythonhtpl_15.fm Page 519 Saturday, December 15, 2001 2:12 PM 





Chapter 15 


Extensible Markup Language (XML) 519 




39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 
81 
82 

83 

84 

85 

86 

87 

88 

89 

90 


<xsl:for-each select = "chapte 
<tr> 

<td style = lign; 

<xsl:value-of select 
</td> 

<td> 

( <xsl:value-of select 
</td> 

</tr> 

</xsl:for-each> 

<xsl:for-each select = "chapte 
<xsl:sort select = 

order = iscending" /> 

<tr> 

<td style = 'text-align; 

Chapter <xsl:value-of 
</td> 

<td> 

( <xsl:value-of select 
</td> 

</tr> 

</xsl:for-each> 

<xsl:for-each select = "chapter 
<xsl:sort select = ber" 

order = .scending" /> 

<tr> 

<td style = text-align: 

Appendix <xsl:value-of 

</td> 

<td> 

( <xsl:value-of select 
</td> 

</tr> 

</xsl:for-each> 

</table> 

<p style = "color: blue">Pages : 
<xsl:variable name = 
select = :(cha; 

<xsl:value-of select 
<br />Media Type: 

<xsl:value-of select 
</body> 

</xsl:template> 


> 

/> 


/> pages ) 


data-type = 


right > 

select = "@mimber" /> 


/> pages ) 



data-type = "text" 

ight > 

select = /> 

/> pages ) 


/> 

/> 

/></p> 


"media/@type" 


</xsl:stylesheet> 








Fig. 15.20 XSLTdocument that tra nsfoims sorting. xml into XHTNIL (Part 2 of 3.) 
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Fig. 15.20 XSLTdocumentthattransforrnssorting.xml into XHTML (Part3of 3.) 

XSLT documents contain one or more xsl: template elements that specify which 
information the XSLT processor outputs to the resuit tree. The template on line 16 
matche s the source tree’s document root. When the document root is encountered during 
the transformation, this template is applied, and any text marked up by this element that 
is not in the namespace referenced by xsl is outputted to the resuit tree. Line 18 calls for 
all the templates that match children of the document root to be applied. Line 23 spec- 
ifies a template that matches element book. 

Lines 25-26 create the title for the XHTML document. We use the ISBN of the book 
from attribute isbn and the contents of element title to create the title string ISBN 
999-99999-9-X - Mary’s XML Primer .Elementxsl :value-of selects the book ele¬ 
menti isbn attribute. 

Lines 33-35 create a header element that contains the book’s author. Because the con- 
textnode (i.e., the current node being processed) is book, the expression author/last- 
Name selects the author’s last name, and the expression author/ f irstName selects the 
author’s first name. 

Line 40 selects each element (indicated by an asterisk) that is a child of element 
frontMatter. Line 43 calls node-setfunction name to retrieve the current node’s ele¬ 
ment name (e.g., preface). The current node is the context node specified in the 
xsl: for-each (line 40). 

Lines 53-54 sort chapters by number in ascending order. Attribute select selects 
the value of context node chapter’ s attribute number. Attribute data- type with 
value "number", specifies anumeric sort and attribute order specifies "ascending" 
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order. Attribute data-type also can be assigned the value "text" (line 67) and 
attribute order also may be assigned the value "descending". 

Lines 82-83 use an XSLT variable to store the value of the book’s page count and 
output it to the resuit tree. Attribute nanae specifies the variable’s name, and attribute 
select assigns it a value. Function sum totals the values for ali page attribute values. 
The two slashes between chapters and * indicate that all descendent nodes of chap- 
ters are searched for elements that contain an attribute named pages. 

Figure 15.21 shows the XHTML that is generated when msxml applies 
sorting.xsl to sorting.xml. In Chapter 16, we use several of Python’s XML- 
related packages to apply XSLT style sheets to XML documents. 

Notice that the XHTML document contains an XML declaration that is different than 
what was shown previously.Value encoding indicates the type of character encoding 
(i.e., a set of numeric values associated with characters) the document uses. This document 
uses UTF-8, which is well suited for ASCII-based systems. UTF-8 is the default encoding 
for XML documents. More information on character encoding and UTF-8 may be found in 
Appendix F, Unicode. 







1 

<?xml version=" 1 .0" encoding= 'TF-8"?> 



2 

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 



3 


11-strict.dtd" > 


4 




5 

<html xmlns="http :/ /www.w3.org/1999/xhtm 

1" > 


6 




7 

<head> 



8 

<title>ISBN 999-99999-9-X - Mary's 

XML Primer</title> 


9 

</head> 



10 




11 

<body> 



12 

<hl style= >Mary's XML 

Primer</hl> 


13 

<h2 style= >by White, 

Mary</h2 > 


14 

<table style= "border-style: groove; 


it " > 

15 




16 

<tr> 



17 

<td style= -align; right 

>pref ace</td> 


18 

<td>( 2 pages )</td> 



19 

</tr> 



20 




21 

<tr> 



22 

<td style= text-align: right 

>contents</td> 


23 

<td>( 5 pages )</td> 



24 

</tr> 



25 




26 

<tr> 



27 

<td style=" text-align. right 

>illustrations</td> 


28 

<td>( 4 pages )</td> 



29 

</tr> 



30 




31 

<tr> 



32 

<td style=“ text-align: right 

>Chapter l</td> 



Fig. 15.21 XHTML generated when sorting.xsl isapplied by msxml to 
sorting.xml. (Part 1 of 2.) 
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33 

<td>( 28 pages )</td> 


34 

</tr> 


35 



36 

<tr> 


37 

<td style= ^ext -align: 

>Chapter 2</td> 

38 

<td>( 35 pages )</td> 


39 

</tr> 


40 



41 

<tr> 


42 

<td style= 

>Chapter 3</td> 

43 

<td>( 44 pages )</td> 


44 

</tr> 


45 



46 

<tr> 


47 

<td style= ^ext align: 

>Appendix A</td> 

48 

<td>( 7 pages )</td> 


49 

</tr> 


50 



51 

<tr> 


52 

<td style="text align: 

>Appendix B</td> 

53 

<td>( 26 pages )</td> 


54 

</tr> 


55 



56 

</table> 


57 



58 

<p style= >Pages: 

ll<br />Media Type: CD</p> 

59 



60 

</body> 


61 < 

/html> 



Fig. 15.21 XHTMLgenerated when sorting.xsl isapplied bymsxmlto 
sorting.xml. (Part 2 of 2.) 



15.9 Internet and VNibrld Wide Web Resources 

www.w3.org/xml 

The W3C (World Wide Web Consortium) works to develop common protocols to ensure interopera- 
bility on the Web. Their XML page includes information about upcoming events, publications, Soft¬ 
ware and discussion groups. Visit this site to read about the latest developments in XML. 

www.xml.org 

xml. org is a reference for XML, DTDs, Schemas and namespaces. This site also contains news on 
how XML relates to industry. 

www.w3.org/style/XSL 

This site provides information on XSL, including what is new in XSL, leaming XSL, XSL-enabled 
tools, the XSL specification, FAQs and the history of XSL. 

www.w3.org/TR 

This W3C technical reports and publications page contains links to working drafts, proposed recorn- 
mendations, recommendations and so on. 


xml.apache.org 

The Apache XML Web site provides many resources related to XML, which include tools and down- 
loads. 
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www.xmlbooks.com 

This site contains a list of XML books recommended by Charles Goldfarb—one of the original de- 
signers of GML (General Markup Language), from which XML’s parent language SGML (Standard 
Generalized Markup Language) was derived. 

wdvl.internet.com/Authoring/Languages/XML 

The Web DeveIoper's Virtual Library XML site includes tutorials, FAQ, the latest news and extensive 
links to XML sites and Software downloads. 


www.xml.com 

Visit xml. com for the latest news and information about XML, conference listings, links to XML 
Web resources organized by topic, tools and more. 

msdn.microsoft.com/xml/default.asp 

The MSDN Online XML Development Center features articles on XML, Ask the Experts chat ses- 
sions, samples and demos, newsgroups and other helpful information. 

www.oasis-open.org/cover/xml .html 

The SGML/XML Web Page is an extensive resource that includes links to FAQs, online resources, in- 
dustry initiatives, demos, conferences and tutorials. 

www.gea.org/whats_xml/default.htm 

The GCA site has an XML glossary, list of books, brief descriptions of the draft standards for XML 
and links to online drafts. 


www.xmlinfo.com 

XMLINFO is a resource site with tutorials, a list of recommended books, documentation, discussion 
forums and more. 


developer.netscape.com/tech/xml/index.html 

The XML and Metadata Developer Central site has demos, technical notes and news articles related 
to XML. 


www.ucc.ie/xml 

This site is a detailed XML FAQ. Submit your own questions through the site. 

www.xml-cml.org 

This site is a resource for the Chemical Markup Language (CML). It includes a FAQ list, documen¬ 
tation, Software and XML links. 


SUMMARY 

• XML is a widely supported open technology (i.e., nonproprietary technology) for data exchange. 

• XML permits document authors to create their own markup for virtually any type of information. 
This extensibility enables document authors to create entirely new markup languages (called vo- 
cabularies) to describe specific types of data, including mathematical formulas, Chemical molecu- 
lar structures, music and recipes. 

• XML allows document authors to create their own tags, so naming collisions (i.e., different ele- 
ments that have the same name) can occur. Namespaces enable document authors to prevent col¬ 
lisions among elements in an XML document. 

• Namespace prefixes prepended to tag names specify the namespace in which the element can be 
found. Each namespace prefix has a corresponding uniform resource identifier (URI) that uniquely 
identifies the namespace. By definition, a URI is a series of characters that differentiates names. 
Document authors can create their own namespace prefixes. Document authors can use virtually 
any namespace prefix except the reserved namespace prefix xml. 
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• To eliminate the need to place a namespace prefix in each element, authors may specify a default 
namespace for an element and ali of its child elements. 

• XML documents are highly portable. Opening an XML document does not require special Soft¬ 
ware—any text editor that supports ASCII/Unicode characters will suffice. One important charae - 
teristic of XML is that it is both human readable and machine readable. 

• Processing an XML document—which typically ends in the . xml extension—requires a Software 
program called an XML parser (or an XML processor). Parsers check an XML document’s syntax 
and can support the Document Object Model (DOM) and/or the Simple API for XML (SAX) API. 

• DOM-based parsers build a tree structure containing the XML document’s data in memory. This 
allows programs to manipulate the document’ s data. SAX-based parsers process the document and 
generate events as the parser encounters tags, text, comments and so on. These events contain data 
from the XML document. 

• An XML document can reference an optional document that defines the XML document’s struc¬ 
ture. This optional document can be either a Document Type Definition (DTD) or a Schema. 

• A DOM tree has a single root node that contains all other nodes in the document. The XML parser 
exposes these methods and properties as a programmatic library, called an Application Program- 
ming Interface (API). 

• A node that contains other nodes (called child nodes) is a parent node. Nodes that are peers are 
sibling nodes. A node’s descendant nodes include that node’s children, its children’s children and 
so on. A node’s ancestor nodes include that node’s parent, its parent’s parent and so on. 

• If the XML document conforms to its DTD or Schema, then the XML document is valid. Parsers 
that cannot check for document conformity against DTDs or Schemas are called nonvalidating 
parsers. If an XML parser (validating or nonvalidating) can process an XML document that does 
not have a DTD or Schema successfully, the XML document is well formed (i.e., it is syntactically 
correct). By definition, a valid XML document also is a well-formed document. 

• The ATTLIST element type declaration in a DTD defines an attribute. Keyword ttIMPLIED 
specifies that, if the parser finds an element without the attribute, the application can provide a val- 
ue or ignore the missing attribute. Keyword ttREQUIRED specifies that the attribute must be in the 
document, and keyword #FIXED specifies that the attribute must have the given value. Flag CDA- 
TA specifies that an attribute contains data that the parser should not process as markup. Keyword 
EMPTY specifies that the element does not contain any text. 

• Flag ttPCDATA specifies that the element can store parsed character data (i.e., text). Document au¬ 
thors must replace the characters less than (<) and ampersand (&) with their corresponding entity 
references (i.e., &lt; and&amp;). 

• Schemas use XML syntax. 

• In XML Schema, element element defines an element. Attributes nane and type specify the 
element’s name and data type, respectively. Any element that contains attributes or child ele¬ 
ments must define a type—called a complex type—that defines each attribute and child element. 

• Attribute minOccurs specifies the minimum number of occurrences for an element. Attribute 
maxOccurs specifies the maximum number of occurrences for an element. 

• When an element is a simple type, such as xsd: string, that element cannot contain attributes 
and child elements. 

• MathML markup describes mathematical expressions. 

• Chemical Markup Language (CML) marks up molecular and Chemical information. 

• The characters < ? and ? > delimit processing instructions (PIs), which are application-specific in¬ 
formation embedded in an XML document. A processing instruction consists of a PI target and a 
PI value. 
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• Extensible Stylesheet Language (XSL) documents specify how programs should render an XML 
document’s data. A subset of XSL—XSL Transformations (XSLT)—provides elements that de- 
fine rules for transforming data from one XML document into another text-based format such as 
XHTML. 

• Transforming an XML document using XSLT involves two tree structures: The source tree (i.e., 
the XML document being transformed) and the resuit tree (i.e., the XML document to create). 


TERMINOLOGY 


ancestor node 

asterisk (*) occurrence indicator 
atomArray element 
ATTLIST element type declaration 
CDATA flag 
child node 

complexType element 
Container element 
context node 
data - type attribute 
default namespace 
descendent node 
doctype-public attribute 
doc type - system attribute 
document reuse 
document root 

Document Type Definition (DTD) 

DOM (Document Object Model) 

DOM API (Application Programming Interface) 

DOM-based XML parser 

EBNF (Extended Backus-Naur Form) grammar 

ELEMENT element type declaration 

empty element 

EMPTY keyword 

event 

Extensible Stylesheet Language (XSL) 

external DTD 

forward slash 

#IMPLIED flag 

invalid document 

match attribute 

maxOccurs attribute 

minOccurs attribute 

mn element 

molecule element 

mrow element 

msqrt element 

msub element 

msubsup element 

msxml parser 

name attribute 

name node-set function 


namespace prefix 
node 

nonvalidating XML parser 
occurrence indicator 
order attribute 
parent node 
parsed character data 
parser 

#PCDATA flag 
PI (processing instruction) 

PItarget 
PI value 

plus sign (+) occurrence indicator 

Processing instruction 

question mark (?) occurrence indicator 

resuit tree 

root element 

root node 

SAX (Simple API for XML) 
SAX-based parser 
schema element 
Schema valid 
select attribute 
simple type 

single-quote character ( 1 ) 
source tree 

stylesheet element 
sum function 
SYSTEM flag 

targetNamespace attribute 

tree-based model 

type attribute 

unbounded value 

validating XML parser 

well-formed document 

XML (Extensible Markup Language) 

XML declaration 

. xml file extension 

xml namespace prefix 

XML parser 

XML processor 

XML Schema 
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XML version 
xmlns keyword 
. xsd extension 

XSL (Extensible Stylesheet Language) 

. xsl extension 

XSL Transformations (XSLT) 

xsl: apply- templates element 


xsl: for-each element 
xsl: output element 
xsl: sort element 
xsl: value-of element 
XSLT variable 

XSV (XML Schema Validator) 




SELF-REVIEW EXERCISES 


15.1 


15.2 


15.3 


15.4 


Which of the following tag names might be found in a well-formed XML document? 

a) yearBorn. 

b) year.Born. 

c) year Born. 

d) year-Bornl. 

e) 2_year_born. 

f) - -year/born. 

g) year*born. 

h) .year_born. 

i) _year_born_. 

j) y_e - a_r - b o - r_n. 


State whether each of the following is true or false. If false, explain why. 

a) XML is a technology for creating markup languages. 

b) Forward and backward slashes (/ and \) delimit XML markup text. 

c) All XML start tags must have corresponding end tags. 

d) Parsers check an XML document’s syntax. 

e) XML, in any mixture of case, is a reserved namespace prefix. 

f) When creating XML documents, document authors must use the set of XML tags that the 
W3C provides. 

g) In an XML document, the pound character (#), the dollar sign ($), ampersand (&), great- 
er-than (>) and less-than (<) must be replaced with their corresponding entity references. 


Fili in the blanks for each of the following statements: 

a) MathML element_defines a mathematical operator. 

b) _help avoid naming collisions. 

c) _embed application-specific information into an XML document. 

d) _is Microsoft’s XML parser. 

e) XSL element_inserts a DOCTYPE in the resuit tree. 

f) XML Schema documents have root element_. 

g) Element_marks up the fclntegral ; MathML entity reference. 

h) _defines attributes in a DTD. 

i) XSL element_is the root element in an XSL document. 

j) XSL element_selects specific XML elements using repetition. 


State whether each of the following is true or false. If false, explain why. 

a) XML is not case sensitive. 

b) An XML document may contain only one root element. 

c) XML is a formatting language. 

d) A DTD/Schema defines the style of an XML document. 

e) MathML is an XML vocabulary. 

f) XSL is an acronym for XML Stylesheet Language. 
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g) The < ! ELEMENT 1 ist (item*) > defines element 1 ist as containing one or more 
item elements. 

h) XML documents must have the . xml extension. 

15.5 Find the error(s) in each of the following and explain how to correct it (them). 

a) <job> 

<title>Manager</title> 

<task number = "42"> 

</j ob> 

b) <mfrac> 

<mi>x</mi> 

<mo>+</mo> 

<mn>4</mn> 

<mi>y</mi> 

</mfrac> 

c) <company name = /> 

15.6 What is the #PCDATA flag used for? 

15.7 Write a processing instruction for Internet Explorer that includes the style sheet wap .xsl. 

ANSWERS TO SELF-REVIEW EXERCISES 

15.1 a, b, d, i, j. [Choice c is incorrect because it contains a space; Choice e is incorrect because 
the first character is a number; Choice f is incorrect because it contains a division Symbol (/) and does 
not begin with a letter or underscore; Choice g is incorrect because it contains an asterisk (*); Choice 
h is incorrect because the first character is a period (.) and does not begin with a letter or underscore.] 

15.2 a) True. b) False. In an XML document, markup text is delimited by angle brackets (< and 
>) with a forward slash being used in the end tag. c) True. d) True. e) True. f) False. When creating 
tags, document authors may use any permissible name except the reserved word xml in any mixture 
of case, g) False. The ampersand (&) and the left-angle bracket (<) must be replaced with their entity 
references. 

15.3 a) mo. b) namespaces. c) processing instructions. d) msxml. e) xsl: output. f) Schema, 
g) mo. h) ATTLIST. i) xsl: stylesheet. j) xsl: for-each. 

15.4 a) False. XML is case sensitive, b) True. c) False. XML organizes data in a structured man- 
ner. d) False. A DTD/Schema defines an XML document’s structure, e) True. f) False. XSL is an ac- 
ronym for Extensible Stylesheet Language. g) False. Element list can contain any number of 
optional item elements. h) False. An XML document can have any extension. 

15.5 a) The closing / in empty element task is missing: 

<task number = "42" /> 

b) <mrow> tag is needed to contain x + 4. 

c) The ampersand must be replaced with &amp;: 

ccompany name = "Deitel &amp; Associates, Inc. " /> 

15.6 Flag #PCDATA denotes that parsed character data is contained in the element. 

15.7 <?xsl: stylesheet type = “text/xsl" href = "wap .xsl"?> 

EXERCISES 

15.8 Create an XML document that marks up the nutrition facts for a package of Grandma Deitel’ s 
Cookies. A package of Grandma Deitel’s Cookies has a serving size of 1 package and the following 
nutritional value per serving: 260 calories, 100 fat calories, 11 grams of fat, 2 grams of saturated fat, 
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5 milligrams of cholesterol, 210 milligrams of sodium, 36 grams of total carbohydrates, 2 grams of 
fiber, 15 grams of sugar and 5 grams of protein. Load the XML document in Internet Explorer. [Hint: 
Your markup should contain elements that describe the product narne, serving size/amount, calories, 
sodium, cholesterol, protein, etc. Mark up each nutrition fact/ingredient listed above.] 

15.9 Write an XSLT style sheet for your solution to Exercise 15.8 that displays the nutritional 
facts in an XHTML table. 

15.10 Write an XML document that marks up the following information in Fig. 15.22. 

15.11 Write a DTD for the XML document in Exercise 15.10. 

15.12 Modify your solution to Exercise 15.10 to qualify each person with a namespace prefix cor- 
responding to their job. Your solution should not contain any elements or attributes that identify a per¬ 
soni job. 

15.13 Write an XSLT document that transforms the XML document of Exercise 15.10 into an 
XHTML sorted table. 

15.14 Modify Fig. 15.20 (sorting. xsl) to sort each section (i.e., front matter, chapters and ap¬ 
pendix) of the book by page number, rather than by section. 


Name 

Job 

Department 

C ubic le 

Joe 

Programmer 

Engineering 

5E 

Erin 

Designer 

Marketing 

9M 

Melissa 

Designer 

Human Resources 

8H 

Craig 

Administrator 

Engineering 

4E 

Eileen 

Project Coordinator 

Marketing 

3M 

Danielle 

Programmer 

Engineering 

12E 

Frank 

Salesperson 

Marketing 

17M 

Corinne 

Programmer 

Technical Support 

19T 


Fig. 15.22 Information forExercise 15.10. 
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Objectives 

• To create XML markup programmatically. 

• To use the Document Object Model (DOM™) to 
manipulate XML documents. 

• To use the Simple API for XML (SAX) to retrieve 
data from XML documents. 

• To create an XML-based message forum. 

Knowing trees, I understand the meaning of patience. 
Knowing grass, I can appretiate persistence. 

Hal Borland 

I think that I shall never see 
A poem lovely as a tree. 

Joyce Kilmer 

Iplayed with an idea , and grew willful; tossed it into the air; 
transformed it; let it escape and recaptured it; made it 
iridescent withfancy, and winged it with paradox. 

Oscar Wilde 



■m 
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Outiine 

16.1 Introduction 

16.2 Generating XMLContentDynamically 

16.3 XMLFtocessing Rackages 

16.4 DocumentObjectModel (DOM) 

16.5 Paising XMLwith xml. sax 

16.6 Case Sbudy: Message Fbiumswith Python and XML 

16.6.1 Displaying the Foiums 

16.6.2 Adding Forumsand Messages 

16.6.3 AHeiationsforBiowseis withoutXMLand XSLTSupport 

16.7 Internet and World Wide Web Resources 

Summary • Terminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 


16.1 Introduction 

In Chapter 15, we introduced XML and various XML-related technologies. In this chapter, 
we demonstrate how Python applications and Scripts can process XML documents. Support 
for XML is provided through a large collection of freely available Python packages and 
modules. This chapter focuses on the two of these Python packages: 4DOM and xml. sax. 

In this chapter, we discuss how to generate XML content programatically. We intro- 
duce DOM- and SAX-based parsing for programmatically manipulating an XML docu¬ 
menti data. The chapter concludes with a case study that uses XML to mark up an Online 
message forum’s data. 

16.2 Generating XMLContentDynamically 

The process by which Python applications can generate XML dynamically is similar to the 
process by which they generate XHTML. For example, to output XML from a Python 
script, we can use print statements or we can use XSLT. 

In this section, we present a simple Python script that creates an XML document from 
data in a text file (Fig. 16.1). The XML markup is sent to the browser via print state¬ 
ments. In Section 16.4, we present more sophisticated techniques for creating and manipu¬ 
lating XML documents. Figure 16.2 is the Python script that marks up the text file’s data 
as XML. [Note: Files names . txt, f igl6_02 .py and contact_list. xsl must be 
placed in the correct directories for this example to be served by Apache. Specifically, 
names.txt and figl6_02.py must be located in Apache’s cgi-bin directory. 
contact list.xsl must be located in a directory called XML under Apache’s 
htdocs directory. The correct directory structure can also be seen in Fig. 16.19.] 


1 0'Black, John 

2 Green, Sue 


Fig. 16.1 Text file names . txt used in Fig. 16.2. (Part 1 of 2.) 
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3 Red, Bob 

4 Blue, Mary 

5 White, Mike 

6 Brown, Jane 

7 Gray, Bili 


Fig. 16.1 Text file names . txt used in Fig. 16.2. (Part 2 of 2.) 




1 #!c: \Python\python .exe 

2 # Fig. 16.2: figl6_02.py 

3 # Marking up a text file's data as XML. 

4 

5 import sys 

6 

7 print "Content-type: text/xml\n" 

8 

9 # write XML declaration and Processing instruction 

10 print ""<?xml version = "1.0"?> 

11 <?xml:stylesheet type = "text/xsl" 

12 href = /XML/contact_list.xsl" 

13 

14 # open data file 

15 try: 

16 file = open( 

17 except IOError: 

18 sys .exit( 

19 

20 print "<contacts>" # write root element 

21 

22 # list of tuples: 

23 replaceList = [ ( 

24 ( 

25 ( 

26 ( 

27 ( 

28 

29 # replace special characters with entity references 

30 for currentLine in f ile.readlines(): 

31 

32 for oldValue, newValue in replaceList: 

33 currentLine = currentLine.replace( oldValue, newValue ) 

34 

35 # extract lastname and firstname 

36 last, first = currentLine.split( ) 

37 first = first.strip () 

38 

39 # write contact element 

40 print <contact>" 

41 <LastName>%s</LastName> 

42 <FirstName>%s</FirstName> 

43 % ( last, first ) 

44 


( special character, entity reference ) 

, ) , 

, ) , 

, ) , 

, ) , 

, ) ] 







Fig. 16.2 Marking up a textfile'sdata asXML (Part 1 of 2.) 
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45 file.closeO 

46 

47 print 








Fig. 16.2 Marking up a textfile'sdata asXML (Part 2 of 2.) 

Line 7 prints the HTTP header, which sets the MIME type to text/xml. Lines 10- 
12 print the XML declaration and a processing instruction for Internet Explorer. The Pro¬ 
cessing instruction references the XSLT style sheet contact_list .xsl (Fig. 16.3). 

After the script prints the headers, lines 15-18 open the file (or exit, if the file could not 
be opened). Line 20 prints the <contacts> start tag of the root element. Alist of five tuples 
is created in lines 23-27. Each tuple contains two values: a character and an entity reference 
that corresponds to that character. The for loop in lines 30-43 generates XML elements for 
each name in the file. Lines 32-33 call method replace to substitute characters (e.g., <, &, 
etc.) with their corresponding entity references. The split method (line 36) extracts the last 
name and first name from the line read from the file. Line 37 removes any whitespace (e.g., 
a carriage return) from the first name. The XML element containing the person’s name is 
printed in lines 40-43. Finally, line 47 prints the root element’s end tag. 


1 

<?xml version = "1.0"?> 


2 

<!-- Fig. 16.3: contact list.xsl --> 


3 

<!-- Formats a contact list --> 


4 



5 

<xsl:stylesheet version = 0 " 


6 

xmlns:xsl = "http://www.w3.org/1999/XSL/ 

Transform" > 

7 



8 

<!-- match document root --> 


9 

<xsl:template match = > 


10 



11 

<html xmlns = "http://www.w3.org/1999 

/xhtml > 

12 




Fig. 16.3 XSLTused to format contact list. (Part 1 of 2.) 
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13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 


<head> 

<title>Contact List</title> 
</head> 

<body> 

<table border = > 

<thead> 

<tr> 

<th>First Name</th> 
<th>Last Name;/th> 

</tr> 

</thead> 


<!-- process each contact element --> 

<xsl:for-each select = contacts/contac > 

<tr> 

<td> 

<xsl:value-of select = /> 

</td> 

<td> 

<xsl:value-of select = ast /> 

</td> 

</tr> 

</xsl:for-each> 


</table> 

</body> 

</html> 

</xsl:template> 
</xsl:stylesheet> 


Fig. 16.3 XSLTused to format contact list. (Part 2 of 2.) 

16.3 XMLRocessing Packages 

In the remaining sections of this chapter, we provide several examples of XML processing 
using the Document Object Model (DOM) and Simple API for XML (SAX). At the time 
of this writing, the modules included with Python for DOM manipulation were 
xml.minidom and xml .pulldom. Neither of these DOM implementations is fully 
compliant with the W3C’s DOM Recommendation. Therefore, we use a third-party pack- 
age called 4DOM, which fully complies with the W3C’s DOM Recommendation. 4DOM is 
included with the package PyXML 1 (pyxml.sourceforge.net). The classes and 
functions provided by 4D0M are located in xml. dom. ext. 

In Section 16.5, we use a package that is included with Python 2 — xml. sax — that 
contains classes and functions for SAX-based parsing. 




1. Visit www. deitel. com for installation instructions. 

2. Version 2.0 and higher. 
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Another package, 4XSLT, contains an XSLT processor for transforming XML docu- 

-2 

ments into other text-based formats. 4XSLT is located in a package called 4Sui te 
(4 sui te . org), from Fourthought, Inc. The classes and functions provided by 4XSLT are 
located in xml. xs 11. 

16.4 Document Object Model (DOM) 

In Chapter 15, we introduced the Document Object Model (DOM). In this section, we 
demonstrate how to use Python and the DOM API to manipulate XML documents pro- 
gramatically. 

Figure 16.4 takes an XML document (Fig. 16.5) that marks up an article and uses the 
DOM implementation included in 4DOM to display the document’s element names and 
values. 




1 # Fig. 16.4: figl6 04.py 

2 # Using 4DOM to traverse an XML Document. 

3 

4 import sys 

5 from xml.dom.ext import StripXml 

6 from xml.dom.ext.reader import PyExpat 

7 from xml.parsers.expat import ExpatError 

8 

9 # open XML file 

10 try: 

11 file = open( 

12 except IOError: 

13 sys.exit( 

14 

15 # parse contents of XML file 

16 try: 

17 reader = PyExpat.Reader() 

18 document = reader.fromStream( file ) 

19 file.closeO 

20 except ExpatError: 

21 sys.exit( ) 

22 

23 # get root element 

24 rootElement = StripXml( document.documentElement ) 

25 print % \ 

26 rootElement.nodeName 

27 

28 # traverse all child nodes of root element 

29 print "The following are its child elements:" 

30 

31 for node in rootElement.childNodes: 

32 print node.nodeName 

33 


Fig. 16.4 Traversing an XMLdocument. (Part 1 of 2.) 



3. PyXML must be installed prior to installing 4Suite. Visit www. deitel. com for installation 
instructions. 
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34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 


# get first child node of root element 

child = rootElement.firstChild 

print , child.nodeName 

print , 

# get next sibling of first child 

sibling = child.nextSibling 
print sibling.nodeName 

print % sibling.nodeName, 

value = sibling.firstChild 

# print text value of sibling 

print value.nodeValue 

print % \ 

( sibling.nodeName, sibling.parentNode.nodeName ) 

reader.releaseNode( document ) 


Here is the root element of the document: article 

The following are its child elements: 

title 

date 

author 

summary 

content 

The first child of root element is: title 
whose next sibling is: date 
Value of "date" is: December 19, 2001 
Parent node of date is: article 


Fig. 16.4 Travensing an XMLdocument. (Part2 of 2.) 


Lines 10-11 attempt to open article2.xml for reading. If the file cannot be 
opened, the program exits with the message "Error opening file" (lines 12-13). 
Line 17 instantiates a PyExpat Reader object, which is an instance of a DOM-based 
parser. Module PyExpat is located in 4DOM’s reader package. Line 18 passes the XML 
document referenced by file to Reader method fromStream. which parses the doc¬ 
ument and loads the XML document’s data into memory.Variable document references 
the DOM tree (called a Documen t) returned by fromStream. 

A Document object’s documentElement attribute refers to the Document’s root 
element node. Line 24 passes the root element node to 4DOM's StripXml function, which 
removes insignificant whitespace (e.g., the carriage return line feeds and spaces used for 
indentation) from an XML DOM tree. If StripXml is not called, insignificant whitespace 
would be stored in the DOM tree. Recall from Chapter 15, that a DOM tree contains a set 
of nodes. Each node in a DOM tree is of a type derived from class Node. We say more 
about these derived classes momentarily. 

Lines 25-26 print the name of rootElement via its nodeName attribute. A Node 
object’s childNodes attribute is a list of that Node’s children. Lines 31-32 print the 
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nodeName of each child node of rootElement. Lines 35^9 then print the names of 
specific nodes. A Node object’s firstChild attribute corresponds to the first child node 
in that Node’s list of children. Lines 35-36 assign the first child of rootElement to vari- 
able child and print the child’s name. 

Line 40 assigns the next sibling of child to variable sibling. Attribute 
nextSibling contains a node’s next sibling (i.e., the next node that has the same parent 
node). For example, title, date, author, summary and content are sibling nodes. 
Line 41 prints sibling’s name. 

Line 44 assigns the first child node of sibling to variable value. In this case, 
value is a Text node that represents the contents of sibling. Text nodes contain 
character data. Line 47 prints the text contained in value by accessing its nodeValue 
attribute. Lines 48-49 print sibling’s parent node. Parent nodes are obtained through the 
parentNode attribute. Finally, line 51 calls Reader method releaseNode, which 
removes the specified Document (i.e., DOM tree) from memory. 



Good Programming Practice 16.1 

Although not required in Python version 2.0 and higher, calling method rei easeNode en- 
sures that a DOM tree isfreedfrom memory. 


The classes that inherit from Node represent the various XML node types. The Doc¬ 
ument node represents the entire XML document (in memory) and provides methods for 
manipulating its data. Element nodes represent XML elements. Text nodes represent 
character data. A t tr nodes represent XML attributes, and Commen t nodes represent com- 
ments. Document nodes can contain Element, Text and Comment nodes. Element 
nodes can contain Attr. Element, Text and Comment nodes. 


1 <?xml version = .0 ?> 

2 

3 <!-- Fig. 16.5: article2.xml --> 

4 <!— Article formatted with XML --> 

5 

6 <article> 

7 

8 <title>Simple XML</title> 

9 

10 <date>December 19, 2001</date> 

11 

12 <author> 

13 <f irstName>Jane</f irstName> 

14 <lastName>Doe</lastName> 

15 </author> 

16 

17 <summary >XML is easy.</summary> 

18 

19 <content>Once you have mastered XHTML, XML is learned 

20 easily. Remember that XML is not for displaying 

21 information but for managing information. 

22 </content> 

23 

24 </article> 






Fig. 16.5 XMLdocument used in Fig. 16.4. 
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The tables in Fig. 16.6-Fig. 16.12 summarize important DOM attributes and methods 
for navigating and updating DOM trees. Figure 16.6 describes some Node attributes and 
methods, Fig. 16.7 describes some NodeList (i.e., an ordered list of Nodes) attributes 
and methods, Fig. 16.8 describes some NamedNodeMap (i.e., an unordered dictionary of 
Nodes) attributes and methods, Fig. 16.9 describes some Document attributes and 
methods, Fig. 16.10 describes some Element attributes and methods, Fig. 16.11 
describes some Attr attributes and Fig. 16.12 describes a Text and Comment attribute. 

The program in Fig. 16.13 uses the DOM to add names to the contact list XML docu¬ 
ment, contacts.xml (Fig. 16.14). The XML document is loaded into memory, pro- 
grammatically manipulated and saved to disk (overwriting the previous version). 






Attribute/ Method 

Desc ription 

appendChild ( newChild ) 

Appends newChild to the list of child nodes. 
Retums the appended child node. 

attributes 

NamedNodeMap that contains the attribute nodes 
for the current node. 

childNodes 

NodeList that contains the node’s current 

children. 

firstChild 

First child node in the NodeList or None, if the 
node has no children. 

insertBefore ( newChild, refChild ) 

Inserts the newChild node before the refChild 
node. refChild must be a child node of the current 
node; otherwise, insertBefore raises a 
ValueError exception. 

isSameNode ( other ) 

Returns true if other is the current node. 

lastChild 

Last child node in the NodeList or None, if the 
current node has no children. 

nextSibling 

The next node in the NodeList, or None, if the 
node has no next sibling. 

nodeName 

Name of the node, or None, if the node does not 
have a name. 

nodeType 

Integer that represents the node type. Class Node 
deftnes several constants including: 

ELEMENT_NODE = 1 

ATTRIBUTE_NODE = 2 

TEXT_NODE=3 

COMMENT_NODE = 8 

DOCUMENT NODE = 9 

nodeValue 

The current node's value, or None, if the node has 
no value. 

parentNode 

Parent node or None if the node has no parent. 


Fig. 16.6 Node attributes and methods. (Part 1 of 2.) 
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Attribute/ Method 


Desc ription 


previousSibling The previous node in the NodeList, or None, if 

the node has no preceding sibling. 

removeChild ( oldChild ) Removes a child node. oldChild must be a child 

node of the current node; otherwise, a Value- 
Error exception is raised. 

replaceChild ( newChild, oldChild ) Replaces oldChild with newChild. oldChild must 

be a child node of the current node; otherwise, 

replaceChild raises a ValueError excep¬ 
tion. 




Fig. 16.6 

Node a ttributes and methods. (Part 2 of 2.) 

Attribute/ Method 

Desc ription 

item ( i ) 

length 


Returns the node at index i. Indices range from 0 to length - 1. 

Number of nodes in the NodeList. 

Fig. 16.7 

NodeList attributesand methods. 

Attribute/ Method 

Desc ription 

item ( i ) 

length 


Returns the attribute node at index i. Indices range from 0 to length - 1. 
Number of attribute nodes for the given element node. 

Fig. 16.8 

NamedNodeMap attributesand methods. 

Attribute/ Method 

Desc ription 


createAttribute( name ) 
createComment ( data ) 
createElement ( tagName ) 
createTextNode ( data ) 

documentElement 


Creates and returns an Attr node with the specified 
name. 

Creates and returns a Comitient node that contains 
the specified data. 

Creates and returns an EI ement node with the 
specified tagName. 

Creates and returns a Text node that contains the 
specified data. 

Root element node of the document tree (DOM tree). 








Fig. 16.9 Document attributesand methods (Part 1 of 2.) 
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Attribute/ Method 

Desc ription 

getElementsByTagName( name ) 

Retums a NodeList of all nodes in the subtree 
with the tag name name. 

Fig. 16.9 Document attributesand methods (Part 2 of 2.) 

Attribute/ Method 

Desc ription 

getAttribute( name ) 

Retums XML attribute name' s value as a string. 

getAttributeNode( name ) 

Retums the Attr node for XML attribute name. 

getElementsByTagName( name ) 

Retums a NodeList of all nodes in the subtree 
with the tag name name. 

removeAttribute( name ) 

Removes XML attribute name (specified as a string) 
from the XML attribute list for the given element 
node. 

removeAttributeNode( name ) 

Removes Attr node name from the XML attribute 
list for the given Element node. 

setAttribute ( name, value ) 

Changes the value of XML attribute name to value. 
Both arguments are specified as strings. 

setAttributeNode( name ) 

Adds new Attr node name to the attribute list for 
the given element node. If the attribute already 
exists, the new attribute replaces the current 
attribute. 

tagName 

Element’s tag name. 


Fig. 16.10 Element attributesand methods. 

Attribute 

Desc ription 

name 

prefix 

Name of the XML attribute. 

Namespace prefix, if it exists, or None. 

Fig. 16.11 . 

Attr attributes. 

Attribute 

Desc ription 

data 

Node’s (Text or Comment) data. 





Fig. 16.12 Textand Comment attribute. 



































pythonhtpl_16.fm Page 540 Wednesday, December 19, 2001 2:46 PM 





540 Python XML Processing 


Chapter 16 




1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 


# Fig. 16.13: figl6JL3.py 

# Using 4D0M to manipulate an XML Document. 
import sys 

from xml.dom.ext.reader import PyExpat 
from xml.dom.ext import PrettyPrint 

def printlnstructions(): 

print "" "\nEnter 'a' to add a contact. 


def printList( document ): 

print "Your contact list is " 

# iterate over NodeList of contact elements 

for contact in document.getElementsByTagName( ): 

first = contact.getElementsByTagName( )[ ] 

# get first node's value 

firstText = first.firstChild.nodeValue 


# get NodeList for nodes that contain tag name 

last = contact.getElementsByTagName( 
lastText = last.firstChild.nodeValue 

print firstText, lastText 


"LastName" 


) [ 1 



def addContact( document ): 

root = document.documentElement 


name = raw_input( 


) 


first, last = name.splitO 

# create first name element node 

firstNode = document.createElement( ) 

firstNodeText = document.createTextNode( first ) 
firstNode.appendChild( firstNodeText ) 

# create last name element node 

lastNode = document.createElement( ) 

lastNodeText = document.createTextNode( last ) 
lastNode.appendChild( lastNodeText ) 

# create contact node, append first name and last name nodes 

contactNode = document.createElement( ) 

contactNode.appendChild( firstNode ) 
contactNode.appendChild( lastNode ) 

root.appendChild( contactNode ) 








Fig. 16.13 Manipulating an XMLdocument. (Part 1 of 2.) 
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54 






55 

# open contacts file 





56 

try : 





57 

file = open( 

/ 

) 



58 

except IOError: 





59 

sys.exit( 


) 



60 






61 

# create DOM parser and parse 

XML 

document 



62 

reader = PyExpat.Reader() 





63 

document = reader.fromStream( 

file ) 



64 






65 

printList( document ) 





66 

printlnstructions() 





67 

character = 





68 






69 

while character != : 





70 

character = raw input( 

) 




71 






72 

if character == : 





73 

addContact( document ) 





74 

elif character == : 





75 

printList( document ) 





76 

elif character == : 





77 

printlnstructions() 





78 

elif character != : 





79 

print Invalid command! 





80 






81 

file.seekt , ) 

# 

position 

to beginning 

of file 

82 

file.truncate() 

# 

remove data from file 


83 

PrettyPrint( document, file ) 

# 

print DOM 

contents to 

file 

84 

file.close() 

# 

close XML 

file 


85 

reader.releaseNode( document 

) 

free memory 


Your contact list is: 





John Black 





Sue 

Green 





Enter 'a' to add a contact. 





Enter '1' to list contacts.xml. 





Enter 'i' for instructions. 





Enter 'q' to quit. 





? a 






Enter the name of the person you 

wish 

to add: Michael Red 


? 1 






Your contact list is: 





John Black 





Sue 

Green 





Michael Red 





? q 







Fig. 16.13 Manipulating an XMLdocument. (Part 2 of 2.) 
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Line 57 opens contacts .xml for reading and writing. A parser object is instanti- 
ated on line 62. Line 63 calls method f romStreamto parse the XML document and build 
the DOM tree. 

Line 65 calls function printList (lines 14-28) to print the contact list to the screen. 
Method getElementsByTagName (line 18) returns a NodeList that contains all Ele- 
ment nodes that have contact for a tag name. Line 19 calls getElementsByTagName 
to obtain a NodeList for all Element nodes that have FirstName for a tag name. Each 
node referenced by contact contains only one such node. This one node is accessed as the 
first element in the list (i.e., [ 0 ]). Line 22 assigns the value of f irst’s first child element 
(a Text node) to variable f irstText. Lines 25-26 repeat the processes to obtain the last 
name. Line 28 prints the current contact’s first name and last name to the screen. 

Line 66 calls function printlnstructions to print the program’s instructions. 
Lines 69-79 get the user’s choice and call the appropriate function. 

The addContact function (lines 30-53) adds a contact to the list. The Document’s 
root element is obtained via its documentElement attribute (line 31). Lines 33-36 prompt 
the user for input and call string method split to separate the first name from the last name. 

Line 39 calls the Document’s crea teElement method to create an Element node 
with the tag name FirstName. Lines 40-41 create and append a Text node to this Ele¬ 
ment node by calling the createTextNode and appendChild methods, respectively. 
Lines 44—46 create an Element node with the tag name LastName in a similar manner. 

Line 49 creates an Element node with the tag name contact. Lines 50-51 call 
method appendChild to add the Element nodes referenced by firstNode and 
lastNode to the node referenced by contactNode. Line 53 calls method append¬ 
Child to add the node referenced by contactNode to the node referenced by root. 

When the user has finished adding names to the contact list, the file is saved. The seek 
method (line 81) positions the file pointer to the beginning of the file and method trun¬ 
cate (line 82) deletes the contents of the file. Then, 4DOM’s PrettyPrint function 
writes the updated XML to the file (line 83). Function PrettyPrint writes an XML 
DOM tree’s data to a specified output stream (with indentation and carriage returns for 
readability). Lines 84-85 close the file and release the DOM tree from memory. 


1 <?xml version="l 0" encoding= UTF-8”?> 

2 <!DOCTYPE contacts> 

3 <contacts> 

4 <contact> 

5 <LastName>Black</LastName> 

6 <FirstName>John</FirstName> 

7 </contact> 

8 <contact> 

<LastName>Green</LastName> 

10 <FirstName>Sue</FirstName> 

11 </contact> 

12 <contact> 

13 <FirstName >Michael</FirstName> 

14 <LastName>Red</LastName> 

15 </contact> 

16 </contacts> 


Fig. 16.14 Contact list output by Fig. 16.13. 
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16.5 Raising XMLwith xml. sax 


In this section, we discuss the xml. sax package, which provides a set of modules for 
SAX-based parsing. With SAX-based parsing, the parser reads the input to identify the 
XML markup. As the parser encounters markup, the parser calls eveni handlers (i.e., meth- 
ods). For example, when the parser encounters a start tag, the startElement event han- 
dler is called; when the parser encounters character data, the characters event handler 
is called. Programmers override event handlers to provide specialized processing of the 
XML. Some common SAX event handlers are shown in Fig. 16.15. 



Good Programming Practice 16.2 

Review the Python on-line documentationfor a complete listing ofxml. sax event handlers. 
This Information can befound at: 

www.python.org/doc/current/lib/content-handler-obj ects.html 


Figure 16.16 demonstrates SAX-based parsing. This program allows the user to 
specify a tag name to search for in an XML document. When the tag name is encountered, 
the program outputs the element’s attribute-value pairs. Methods startElement and 
endElement are overriden to handle the events generated when start tags and end tags 
are encountered. Figure 16.17 contains the XML document used by this program. 

Lines 42^43 obtain the name of the XML document to parse and the tag name to locate. 
Line 46 invokes xml. sax function parse, which creates a SAX parser object. Function 
parse’s first argument is either a Python file object or a filename. The second argument 
passed to parse must be an instance of class xml. sax. ContentHandler (or a 
derived class of ContentHandler, such as TaglnfoHandler), which is the main 
callback handler in xml. sax. Class ContentHandler contains the methods 
(Fig. 16.15) for handling SAX events. 

If an error occurs during the opening of the specified file, an IOError exception 
is raised, and line 50 displays an error message. If an error occurs while parsing the file 
(e.g., if the specified XML document is not well-formed), parse raises a SAX- 
ParseException exception, and line 54 displays an error message. 


Event Handler 

Desc ription 

characters ( content) 

Called when the parser encounters character data. The 
character data is passed as content to the event handler. 

endDocument() 

Called when the parser encounters the end of the docu¬ 
ment. 

endElement ( name ) 

Called when the parser encounters an end tag. The tag 
name is passed as an argument to the event handler. 

startDocument() 

Called when the parser encounters the beginning of the 
document. 

startElement ( name, attrs ) 

Called when the parser encounters a start tag. The tag 
name and its attributes {attrs) are passed as arguments to 
the event handler. 


Fig. 16.15 xml. sax event-handlermethods. 
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# Fig. 16.16: figl6_16.py 

# Demonstrating SAX-based parsing. 

from xml.sax import parse, SAXParseException, ContentHandler 
class TaglnfoHandler( ContentHandler ): 

def _ init_( self, tagName ): 

"""Initialize ContentHandler and set tag to search for 

ContentHandler._init_( self ) 

self.tagName = tagName 

self.depth = 0 # spaces to indent to show structure 

# override startElement handler 

def startElement( self, name, attributes ): 

"""An Element has started. 1 


# check if this is tag name for which we are searching 

if name == self.tagName: 

print % ( * self.depth, name ) 


self.depth += 

print "%sAttributes: 


* 


self.depth 


) 



# check if element has attributes 

for attribute in attributes.getNames(): 

print % ( * self.depth, attribute, 

attributes.getValue( attribute ) ) 


# override endElement handler 
def endElement( self, name ): 

■i ii 'iAn Element has ended" " " 


if name == self.tagName: 
self.depth -= 

print % ( * self.depth, name ) 

def main(): 

file = raw_input( ) 

tagName = raw_input( ) 


try : 

parse( file, TaglnfoHandler( tagName ) ) 

# handle exception if unable to open file 

except IOError, message: 

print , message 








Fig. 16.16 SAX-based parsing example. (Part 1 of 2.) 
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52 # handle exception parsing file 

53 except SAXParseException, message: 

54 print , message 

55 

56 if _ name_ == : 

57 main() 


Enter a file to parse: boxes.xml 
Enter tag to search for: box 

<box> started 
Attributes: 
size = big 

<box> started 
Attributes: 
size = medium 
</box> ended 


<box> started 
Attributes: 
type = small 

<box> started 
Attributes: 
type = tiny 
</box> ended 

</box> ended 

</box> ended 


Fig. 16.16 SAX-based parsing example. (Part2 of 2.) 


Our example overrides only two event handlers. Methods startElement and 
endElement are called when start tags and end tags are encountered. Method start¬ 
Element (lines 16-31) takes two arguments—the element’s tag name as a string and the 
element’s attributes. The attributes are passed as an instance of class Attributeslmpl, 
defined in xml. sax. reader. This class provides a dictionary-like interface to the ele¬ 
menti attributes. 

Line 21 determines whether the element received from the event contains the tag name 
that the user specified. If so, line 22 prints the start tag, indented by depth spaces, and line 
24 increments depth by 3 to ensure that the next tag printed indented further. 

Lines 29-31 print the elementi attributes. The for loop first obtains the attribute 
names by invoking the getNames method of attributes. The loop then prints each 
attribute name and its corresponding value—obtained by passing the current attribute name 
to the getValue method of attributes. 

Method endElement (lines 34-39) executes when an end tag is encountered and 
receives the end tag’s name as an argument. If name contains the tag name specified by the 
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user, line 38 decreases the indent by decrementing depth. Line 39 prints that the specified 
end tag was found. 

16.6 Case Sbudy: Message Forums with Python and XML 4 

In this section, we use XML and several XML-related technologies to create one of the 
most popular types of Web sites: A message forum. Message forums are “virtual” bulletin 
boards where users discuss various topics. Common features of message forums include 
discussion groups, question-and-answer sections and general comments. Many Web sites 
host message forums. Some popular message forums are 


groups.yahoo.com 
web.eesite.com/forums 
groups.google.com 


Figure 16.18 summarizes the files that comprise the message forum. Figure 16.19 
shows the directory structure for Apache running on Windows. Fig. 16.20 illustrates some 
of the key interactions between the files. The main XHTML page generated by 
def ault. py displays the list of available message forums, which are stored in the XML 
document forums . xml. Hyperlinks are provided to each XML message forum document 
and to script addForum. py, which adds a forum to forums . xml and creates an XML 
message forum, using the markup in template. xml as a starting point. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 


<?xml version = " 1 . 0 "?> 

<!-- Fig. 16.17: boxes.xml 

<!-- XML document used in Fig. 16.16 


- > 
- > 



<boxlist> 


<box size = > 

This is the big box. 

<box size = medi' > 

Medium sized box 

<item>Some stuff</item> 

<thing>More stuf f</thing> 

</box> 

<parcel /> 

<box type = "smal > 

smaller stuff 

<box type = " >tiny stuff</box> 

</box> 

</box> 

</boxlist> 


Fig. 16.17 XMLdocumentused in Fig. 16.16. 






4. The implementation of this message forum requires Internet Explorer 5 or higher, and msxml 3.0 
or higher. In Section 16.6.3, we discuss how other client browsers, such as Netscape, may be used. 


































pythonhtpl_16.fm Page 547 Wednesday, December 19, 2001 2:46 PM 






Chapter 16 


Python XML Processing 547 


Each XML document that contains a forum (e.g., feedback.xml) is transformed 
into an XHTML document by applying the XSLT document f ormatting.xsl. The 
XHTML generated is formatted by applying site. css. New messages are posted to a 
forum by addPost.py. 




File Name 

Desc ription 

forums.xml 

XML document containing available forum tities and their filenames. 

default.py 

Main page that provides navigational links to the forums. 

template.xml 

Template for a message forum document. 

addForum.py 

Adds a new forum. 

feedback.xml 

Sample message forum. 

formatting.xsl 

XSLT document for transforming message forums into XHTML. 

addPost.py 

Adds a message to a forum. 

error.html 

Displays an error message. 

site.css 

Style sheet for formatting XHTML content. 

forum.py 

Transforms XML documents to HTML on the server for non-Intemet 
Explorer clients. 


(«) 


Fig. 16.18 Message-forum documents. 
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Fig. 16.19 Directory structure for the message forum. 
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Fig. 16.20 Key interactionsbetween message forum documents. 




16.6.1 Displaying the Forums 

This section discusses how XML is used to mark up message forum data and the Python 
script —default.py— that creates the message forum’s main XHTML page. For this 
case study, we provide a sample forum named feedback.xml (Fig. 16.21) to show the 
structure of a forum document. 

Notice the reference to the style sheet f ormatting.xsl (line 6). When applied by 
msxml, this XSLT document (which we discuss later in the chapter) transforms the XML 
into XHTML for display in Internet Explorer. Forum documents have root element forum, 
which contains attribute file. This attribute’s value is the document’s filename. Child 
elements include name, for specifying the title of the forum, and message, for marking 
up the message. Messages contain a user name, a title and the text, which are marked up by 
elements user, title and text, respectively. Messages also are given a timestamp. 

The document forums.xml (Fig. 16.22) contains the filename and title for every 
message forum. As forums are created, this document is updated. 

Root element forums (line 8) contains one or more forum child elements. Initially, 
one forum (i.e., Feedback) is present. Each forum element has attribute filename and 
child element name. 


1 <?xml version = "1.0 ?> 

2 

3 <!-- Fig. 16.21: feedback.xml --> 

4 <!-- XML document representing a forum --> 

5 

6 <?xml : stylesheet type = "text/xsl" href = "../XML/formatting.xsl " ?> 

7 

8 <forum file = back > 

9 <name>Feedback</name> 

10 






Fig. 16.21 XML document representing a forum containing one message. (Part 1 of 2.) 
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11 <message timestamp = "Wed Jun 27 12:53:22 2001" > 

12 <user>Jessica</user> 

13 <title>Nice forums! </title> 

14 <text>These forums are great! Well done, all.</text> 

15 </message> 

16 

17 </forum> 


Fig. 16.21 XMLdocumentrepresenting a forum containing one message. (Part2 of 2.) 




1 <?xml version = "1.0 ?> 

2 

3 <!-- Fig. 16.22: forums.xml --> 

4 <!-- XML document containing all forums --> 

5 

6 <?xml:stylesheet type = href = 

7 

8 <forums> 

9 

10 <forum filename = feedback > 

11 <name>Feedback</name> 

12 </forum> 

13 

14 </forums> 


Fig. 16.22 XMLdocumentcontaining data forall available forums 



Visitors to the message forum are greeted initially by the Web page that def ault. py 
(Fig. 16.23) generates, which displays links to all forums and provides forum management 
options. Initially, only two links are active—one to view the Feedback forum (i.e., the 
sample forum) and one to create a forum. In the chapter exercises, we ask the reader to 
enhance the message forum by adding functionality for modifying and deleting forums. 


1 #!c: \Python\python .exe 

2 # Fig. 16.23: default.py 

3 # Default page for message forums. 

4 

5 import os 

6 import sys 

7 from xml.dom.ext.reader import PyExpat 

8 

9 def printHeader ( title, style ): 

10 print """Content-type: text/html 

11 

12 <?xml version = "1.0" encoding = "UTF- 

13 

14 "-//W3C//DTD XHTML 1.0 Strict//EN" 

15 

16 <html xmlns = "http://www.w3.org/1999/: 

17 








Fig. 16.23 Default page forthe message forum. (Part 1 of 3.) 
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18 <head> 

19 <title>%s</title> 

20 <link rei = "stylesheet" href = "%s" type = "text/css" /> 

21 </head> 

22 

23 % ( title, style ) 

24 

25 # open XML document that contains the forum names and locations 

26 try: 

XMLFile = open( ) 

28 except IOError: 

29 print 'Locationi /error html\n" 

30 sys.exit() 

31 

32 # parse XML document containing forum information 

33 reader = PyExpat.Reader() 

34 document = reader.fromStream( XMLFile ) 

35 XMLFile.close() 

36 

37 # write XHTML to browser 

38 printHeader( , ) 

39 print 11 ""<hl>Deitel Message Forums</hl> 

40 <p style="font-weight:bold">Available Forum 

41 <ul > 111 

42 

43 # determine client-browser type 

44 if os.environl ].find( 

45 prefix = 

46 else: 

47 prefix = 

48 

49 # add links for each forum 

50 for forum in document.getElementsByTagName( ): 

51 

52 # create link to forum 

53 link = prefix + forum.attributes.item( ).value 

54 

55 # get element nodes containing tag name "name" 

56 name = forum.getElementsByTagName( )[ ] 

57 

58 # get Text node 1 s value 

59 nameText = name.childNodes[ ].nodeValue 

60 print % ( link, nameText ) 

61 

62 print ""</ul> 

63 <p style= H font-weight:bold">Forum Management</p> 

64 <ul> 

65 <lixa href = "addForum.py">Add a Forum</ax/li> 

66 <li>Delete a Forum</li> 

67 <li>Modify a Forum</li> 

68 </ul> 

69 :/body> 

70 







Fig. 16.23 Defaultpage forthe message forum. (Part2 of 3.) 
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71 </html>" " 11 

72 

73 reader.releaseNode( document ) 







Fig. 16.23 Default page forthe message forum. (Part 3 of 3.) 

This Python script uses modules in package 4DOM to parse forums .xml. Lines 33- 
34 instantiate a parser object, then load and parse forums.xml. Lines 38-71 output 
XHTML to the browser. First, line 38 prints the XHTML header for the main page by 
calling function printHeader (lines 9-23). This function prints the XHTML header 
with a specified title and a link to a Cascading Style Sheet (CSS) that formats the page. In 
this case study, we would like to take advantage of msxmks XML parsing and XSLT Pro¬ 
cessing capabilities to reduce the amount of processing the server must perform. Lines 44- 
45 determine whether the client is using Internet Explorer. If so, pref ix is set to 11 . . / 
XML/". Otherwise, prefix is set to 11 forum.py?file=" . Note that line 47 uses 
prefix to construet the hyperlinks to each forum. Clients who use Internet Explorer 
request the XML documents directly, while other clients request forum.py. We discuss 
this in greater detail in Section 16.6.3. The for loop (lines 50-60) retrieves all Element 
nodes that contain the tag name forum. Hyperlinks are created to each forum found in 
forums.xml. Lines 62-71 print the remaining XHTML, including a hyperlink to 
addForum.py. Finally, line 73 releases the Document object from memory. 

16.6.2 Adding Forums and Messages 

In this section, we discuss the Python Scripts and documents that add forums and messages. 
The Python script that adds a new forum is shown in Fig. 16.24. This script uses modules 
in package 4DOM to manipulate XML documents. 

When the script is requested initially, it is not passed any parameters. The script begins 
by retrieving the form data (line 29). Because the form contains no values, exeeution begins 
with the else block at line 93. Lines 94-107 output a form that prompts the user for a 
forum name and a filename for the XML document to be created. When the form is sub- 
















































pythonhtpl_16.fm Page 552 Wednesday, December 19, 2001 2:46 PM 





552 Python XML Processing 


Chapter 16 


mitted, the script is re-requested and passed the user-entered form values. When this occurs, 
the condition (line 32) is true, and lines 33-92 execute. 




1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 


#!c: \Python\python .exe 

# Fig. 16.24: addForum.py 

# Adds a forum to the list 

import re 
import sys 
import egi 

# 4DOM packages 

from xml.dom.ext.reader import PyExpat 
from xml.dom.ext import PrettyPrint 

def printHeader( title, style ): 

print """Content- type: text/html 


% ( title, style ) 
form = egi.FieldStorage() 

# if user enters data in form fields 

if form.has_key( ) and form.haskey( ): 

newFile = form[ ].value 

# determine whether file has xml extension 

if not re.match( , newFile ): 

print 'Location /error,html\n" 

sys.exit() 

else : 

# create forum files from xml files 
try : 

newForumFile = open( 
forumsFile = open( 
templateFile = open( 
except IOError: 

print Location; /er 

sys.exit() 


+ newFile, ) 

, ) 

) 








Fig. 16.24 Scriptthat addsa new forum to forums . xml. (Part 1 of 3.) 
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50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 
81 
82 

83 

84 

85 

86 

87 

88 

89 

90 

91 

92 

93 

94 

95 

96 

97 

98 

99 

100 
101 
102 


# parse forums document 

reader = PyExpat.Reader() 

document = reader.fromStream( forumsFile ) 


# add new forum element 

forum = document.createElement( ) 

forum.setAttribute( , newFile ) 

name = document.createElement( ) 

nameText = document.createTextNode( form[ ].value ) 

name.appendChild( nameText ) 
forum.appendChild( name ) 

# obtain root element of forum 

documentNode = document.documentElement 
firstForum = documentNode.getElementsByTagName( 

) [ 1 

documentNode.insertBefore( forum, firstForum ) 


# write updated XML to disk 

forumsFile.seek( , ) 

forumsFile.truncate() 

PrettyPrint( document, forumsFile ) 
forumsFile.close() 


# create document for new forum from template 

document = reader.fromStream( templateFile ) 
forum = document.documentElement 
forum.setAttribute( , newFile ) 


f 


ile 



# create name element 

name = document.createElement( ) 

nameText = document.createTextNode( form[ ].value ) 

name.appendChild( nameText ) 
forum.appendChild( name ) 

# write generated XML to new forum file 

PrettyPrint( document, newForumFile ) 

newForumFile.close() 

templateFile.close () 

reader.releaseNode( document ) 


print "Location: default.py\n" 

else : 

printHeader( , ) 

print " ""<form action = 11 addForum.py" method= 






Fig. 16.24 Scriptthat addsa new forum to forums . xml. (Part 2 of 3.) 
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103 

104 

105 

106 
107 



3 Bug2Bug Message Forums - Microsoft Internet Explorer 


^jLgjxj 




File Edit View Favorites Tools Help 


J ^Back - - (3 21 -Qsearch 

(jj Favorites ^History y> 

Address |<0] http://localhost/cgi-bin/default.py 

zi ^Go 

H 

Bug2Bug Message Forums 

Available Forums 


• Books 

• Feedback 


Forum Management 


• Add a Forum 

• Delete a Forum 

• Modify a Forum 

d 

e 

jj§fr Local intranet 


Fig. 16.24 Scriptthat addsa new forum to forums . xml. (Part 3 of 3.) 


Line 36 examines the filename posted to the script to make sure it contains only alpha- 
numeric characters and ends with .xml; if not, the script redirects the client to 
error. html. This prevents a malicious user from writing to a system file or otherwise 
gaining unrestricted access to the server. However, it is important to note that other Solu¬ 
tions exist, such as generating filenames on the server. If the filename is permitted, line 43 
attempts to create the file by calling function open. 

Line 44 opens file forums .xml for reading and writing ("r+"). Line 40 opens the 
template XML document named template. xml (Fig. 16.25), which provides a forum’s 
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markup. The template contains an empty f orums element, to which the forum name and 
filename are added programmatically. If an error occurs during an attempt to open any file, 
the client is redirected to error. html. 

Line 51 instantiates a DOM parser and assigns it to variable reader. Line 52 loads 
and parses f orums .xml; the Document object created is assigned to variable docu- 
ment. Because we wish to create a f orumelement within f orums, line 55 calls the Doc¬ 
ument object’s createElement method with the name of the new element 
("forum")- The filename attribute of the new Element node is set by calling 
setAttribute and passing the attribute’s name and value. 

The forum element contains only one piece of information—the forum name—added 
by lines 58-61. Line 58 creates another Element node named name. To add character 
data to the new Element node, achild Text node must be created. We call method cre- 
ateTextNode (line 59) with the forum name from the form (i.e., form[ "name" 
] .value). Line 60 appends the Text node to the Element node referenced by name 
by calling method appendChild. Line 61 adds the Element node referenced by name 
to the Element node referenced by forum. 

Line 64 accesses the documentElement attribute of document to obtain the root 
element node (i.e., f orums). Lines 65-66 obtain a NodeList of ali forum elements by 
calling method getElementsByTagName, the first of which is assigned to variable 
firstForum. Line 67 inserts the new Element node referenced by forum before the 
first child node of f orums by calling method insertBef ore. With this technique, the 
most recently added forums appear first in the forum list. 

To update forums .xml, line 70 seeks to the beginning and deletes any existing 
data (by truncating the file to size 0). Line 72 then calls function PrettyPrint to write 
the updated XML to forums File. 

Line 76 loads and parses file template . xml (Fig. 16.25) by calling method from- 
Stream and assigns the Document object created to variable document. Line 77 uses 
documentElement to get the root element, and line 78 sets its file attribute’s value 
to the specified filename. Lines 81-84 add the name node, and lines 87-88 output the 
updated XML to newForumFile and close the file. Lines 89-90 close template. xml 
and release the Document object from memory. The user is redirected to def ault. py 
in line 92. 

Figure 16.26 contains the Python script that allows users to add messages to a forum. 
When formatting.xsl (Fig. 16.27) is applied to a forum document, a link to 
addPo s t. py is added to the page, which includes the current forum’ s filename. This file¬ 
name is passed to addPost. py (e.g., addPost .py? f ile=f oruml. xml). 


1 

<?xml version = 

' 1.0 " ? > 


2 




3 

<!- - Fig. 16.25: 

template.xml --> 


4 

< !- - Empty forum 

file --> 


5 




6 

<?xml : stylesheet 

type = "text/xsl" href = " . . 

matting.xsl" ?> 

7 

<forum> 



8 

</forum> 




Fig. 16.25 XMLtemplate forgenerating new fomms 
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19 
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23 
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25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 


#!c: \Python\python .exe 

# Fig. 16.26: addPost.py 

# Adds a message to a forum. 

import re 
import os 
import sys 
import egi 
import time 

# 4D0M packages 

from xml.dom.ext.reader import PyExpat 
from xml.dom.ext import PrettyPrint 

def printHeader( title, style ): 

print .Content-type: text/html 


% ( title, style ) 

# identify Client browser 

if os.environl ].find( ) != 

prefix = 

else : 

prefix = 

form = egi.FieldStorage() 

# user has submitted message to post 

if form.has_key( ): 

filename = form[ ].value 

# add message to forum 

if not re.match( , filename ): 

print 'Location /error.html\n" 

sys.exit() 

try : 

forumFile = open( + filename, 

except IOError: 

print 'Location /error.html\n" 

sys.exit() 



) 






Fig. 16.26 Scriptthataddsa message to a fornm. (Part 1 of 3.) 
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95 

96 

97 

98 

99 

100 
101 
102 

103 

104 

105 

106 


# parse forum document 

reader = PyExpat.Reader() 

document = reader.fromStream( forumFile ) 
documentNode = document.documentElement 


# create message element 

message = document.createElement( ) 

message.setAttribute( , time.ctime( time.time() )) 

# add elements to message 

messageElements = [ , , ] 

for item in messageElements: 

if not form.haskey( item ): 
text = 

else : 

text = form[ item ].value 


# create nodes 

element = document.createElement( item ) 
elementText = document.createTextNode( text ) 
element.appendChild( elementText ) 
message.appendChild( element ) 


# append new message to forum and update document on disk 

documentNode.appendChild( message ) 
forumFile.seek( , ) 

forumFile.truncate() 

PrettyPrint( document, forumFile ) 

forumFile.close() 

reader.releaseNode( document ) 


print % ( prefix + form[ ].value ) 

# create form to obtain new message 

elif form.has_key( ): 

printHeader( , ) 

print "" "\n<form action = "addPost.py" method="post"> 






Fig. 16.26 Scriptthataddsa message to a fornm. (Part2of 3.) 
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107 </html: % ( form[ ].value, 

108 prefix + form[ ].value ) 

109 else: 

110 print "Location: /error.html\n" 






Fig. 16.26 Scriptthataddsa message to a forum. (Part3of 3.) 

Line 37 obtains the form values posted to the script. The user has not yet submitted a 
new message; therefore, the form does not contain the value " submi t " (line 40), and exe- 
cution proceeds to line 90. If the form contains a single value (i.e., the filename), lines 91- 
108 output a form, which includes fields for the user name, message title, message text and 
the forum filename as a hidden value (line 99). Note that, if no parameters are passed to the 
script, the script has been accessed in an inappropriate way, and the programs redirects the 
browser to error. html (line 110). 

When the form data are submitted, the posted information is processed, starting at line 
41. As in the previous figure, the filename is checked for an .xml extension, and the file 
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is opened (lines 44—52). Lines 55-61 parse the forum file, create an Element node with 
tag name message and set the node’s timestamp attribute by calling method setAt- 
tribute. 

Lines 64-77 create Element nodes that represent the user, title and text and 
add text that corresponds to the values entered in the form. Note that, if a field has been left 
blank, " ( Field left blank ) 11 is entered for that field. Each new Element node is 
appended to the node referenced by message (line 77). 

Line 80 appends the node referenced by message to the node referenced by forum. 
Lines 81-82 then seek and truncate the XML file to eliminate the file’s content and 
write the updated XML markup. Lines 84-85 close the file and free the Document object 
from memory. The user is redirected to the updated XML document in line 87. 


16.6.3 Aterationsfor Browsers wrthoutXMLand XSLTSupport 


This case study uses an XSLT style sheet (f ormatting. xsl in Fig. 16.27) to transform 
XML data into XHTML that is rendered in Internet Explorer. Recall that each XML docu¬ 
ment sent to Internet Explorer contains a processing instruction that references this style 
sheet. 

Support for XSLT currently is available only for Internet Explorer 5 and higher. This 
means that our message forum application could send XML content to some browsers (e.g., 
Netscape Communicator 6) that do not have built-in XML parsers and XSLT processors. 
To create a more client-independent application, we can parse the XML on the server and 
apply the XSLT transformation on the server. 
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<?xml version = '1.0"?> 

<!-- Fig. 16.27: formatting.xsl --> 

<!-- Style sheet for forum files --> 

<xsl:stylesheet version = 1.0" 

xmlns:xsl = "http://www.w3.org/1999/XSL/Transform"> 

<!-- match document root --> 

<xsl:template match = "/"> 

<html xmlns = "http://www.w3.org/1999/xhtml"> 

<!-- apply templates for all elements --> 

<xsl:apply-templates select = /> 

</html> 

</xsl:template> 

<!-- match forum elements --> 

<xsl:template match = forv > 

<head> 

<titlexxsl: value-of select = /></title> 

clink rei = "stylesheet type = text/css" 

href = . /XML/si /> 

</head> 






Fig. 16.27 XSLTstyle sheet that tra nsforms XML into XHTML. (Part 1 of 3.) 
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26 

<body> 


27 

<table width = "100% cellspacing 

= " 0 " 

28 

cellpadding = ‘ 2 ’ > 


29 

<tr> 


30 

<td class = forumTitle' > 


31 

<xsl:value-of select = 

name" /> 

32 

</td> 


33 

</tr> 


34 

</table> 


35 



36 

<!-- apply templates for message 

elements --> 

37 

<br /> 


38 

<xsl:apply-templates select = 

"message” /> 

39 

<br /> 


40 



41 

<div style = "text-align: center" 

> 

42 

<a> 


43 



44 

<!-- add href attribute to 

"a" element --> 

45 

<xsl:attribute name = iref 

> ../egi-bin/ 

addPost 

.py?file=<xsl :value-of select = 

/> 

46 

</xsl:attribute> 


47 

Post a Message 


48 

</a> 


49 

<br /xbr /> 


50 

<a href = " . ./cgi-bin/default.py 

>Return to Main 

51 

</div> 


52 



53 

</body> 


54 

</xsl:template> 


55 



56 

<!-- match message elements --> 


57 

<xsl:template match = mess > 


58 

<table width = "100%" cellspacing = 


59 

cellpadding = 11 2" > 


60 

<tr> 


61 

<td class = nsgTitle > 


62 

<xsl:value-of select = 

le" /> 

63 

</td> 


64 

</tr> 


65 



66 

<tr> 


67 

<td class = nsgInfo"> 


68 

by 


69 

<xsl:value-of select = "usi. 

/> 

70 

at 


71 

<span class = > 


72 

<xsl:value-of select = 

@timestamp" /> 

73 

</span> 


74 

</td> 


75 

</tr> 


76 




(«) 






Fig. 16.27 XSLTstyle sheetthattransformsXMLinto XHTNIL. (Part2 of 3.) 
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77 

<tr> 


78 

<td class = "msgText > 


79 

<xsl:value-of select = 'te 

xt /> 

80 

</td> 


81 

82 

</tr> 


83 

</table> 


84 

85 

</xsl:template> 


86 

</xsl:stylesheet> 



Fig. 16.27 XSLTstyle sheetthattransformsXMLinto XHINIL. (Part 3 of 3.) 


4XSLT, which is a package included in 4 Sui te, contains an XSLT processor for 
transforming XML into HTML. We can create an instance of this processor for applying 
style sheets to XML documents. 

Recall how the prefix variable in default.py (Fig. 16.23) and addPost.py 
(Fig. 16.26) was used to define where links or redirection statements sent clients. By 
allowing Internet Explorer’s XML parser and XSLT processor to parse the XML and apply 
a style sheet to the XML, we reduce the load on the server. For browsers without XML and 
XSLT support, however, we direct clients to a Python script that parses the XML document 
and sends HTML to the client. 

We therefore insert a browser test at line 44 of default.py and at line 32 of 

addPost.py: 

if os.environt ].find( ) != : 

prefix = 

else : 

prefix = 

Variable prefix is set according to whether MSIE (Microsoft Internet Explorer) appears 
in the HTTP_USER AGENT cnvironment variable. For simplicity, we assume Internet Ex¬ 
plorer 5 or higher (with msxml 3.0 or higher) is the only version of MSIE being used and 
do not test for older versions. 

Once prefix has been set, we may use its value to customize the URLs generated by 
the Scripts. One example occurs in line 87 of addPost .py: 

print % ( prefix + form[ ].value ) 

This line directs Internet Explorer users to the specified XML forum file located in . . / 
XML/, but sends users of other browsers to forum. py, a Python script that receives a sin- 
gle parameter (i.e., the filename). 

Figure 16.28 shows forum.py, which transforms XML documents to HTML on 
the server. The figure also includes the rendered HTML output displayed in Netscape 
Communicator. 

If a filename is not passed to the script, the user is redirected to error. html (line 
40). Otherwise, execution begins at line 16. Lines 16-18 determine whether the specified 
filename ends in .xml. If so, lines 21-22 open the XSLT style sheet (format- 
ting.xsl) and the specified XML document, respectively. If an error occurs during an 
attempt to open one of these files, the user is redirected to error.html (line 24). 
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The XML then is transformed into HTML for display. Line 28 instantiates a 4XSLT 
Processor object, which transforms XML into HTML, by applying an XSLT style 
sheet. Line 31 specifies the appropriate XSLT style sheet by invoking processor’s 
appendStyleSheetStream method. This method appends a style sheet to the list of 
style sheets a Processor can use. Note that more than one style sheet can be appended 
(i.e., appendStyleSheetStream can be called multiple times) so that the same Pro¬ 
cessor object can be used to transform an XML document to many different formats. The 
argument passed to appendStyleSheetStream must be a Python file object. Other 
methods for appending style sheets to a 4XSLT Processor are appendstyleSheet- 
String , appendStyleSheetNode and appendstyleSheetUri, which accept as 
arguments a string containing an XSLT style sheet, a DOM tree containing a style sheet and 
a URI that references a style sheet, respectively. The specified URI may be a URL (in the 
form of a string) that represents the location of the style sheet on the Web. 







1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 


#!c: \Python\python .exe 

# Fig. 16.28: forum.py 

# Display forum postings for non-Internet 

import re 
import egi 
import sys 

from xml.xslt import Processor 
form = egi.FieldStorage() 


Explorer browsers. 



# form to display has been specified 

if form.has_key( ): 

# determine whether file is xml 

if not re.match( , form[ ].value ): 

print 'Location 
sys.exit() 

try : 

style = open( 

XMLFile = open( 
except IOError: 

print 'Location 
sys.exit() 

# create XSLT processor instance 

processor = Processor.Processor() 

# specify style sheet 

processor.appendStyleSheetStream( style ) 


) 

+ form[ ].value ) 


Fig. 16.28 Script that transforms XML into HTMLforbrowserswithoutXSLTsupport. (Part 
lof 2.) 
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33 # apply style sheet to XML document 

34 results = processor.runStream( XMLFile ) 

35 style.close() 

36 XMLFile.close() 

37 print "Content-type: text/html\n" 

38 print results 

39 else: 

40 print "Location: /error.html\n" 






Fig. 16.28 ScriptthattransformsXMLinto HTMLforbrowsenswithoutXSLTsupport. (Part 
2 of 2.) 


Line 34 invokes the Processor’s runStream method to apply the style sheet to 
the XML document. As with appendStyleSheetStream, the object passed to 
runStream must be a Python file object. Other methods used for applying style sheets 
are runString, runNode and runUri , which accept as arguments a string con- 
taining XML, a DOM tree containing XML and a URI that references an XML document, 
respectively. 

Lines 35-36 close the XSLT and XML files used by the script. Line 37 prints the con¬ 
tent type header for the Web browser. The transformed XML is then sent to the client as 
HTML (line 38). 

In this chapter, we used the concepts presented in Chapter 15 to create XML-based 
applications. We used Python packages containing DOM implementations and SAX 
implementations to parse our XML documents, then used XSLT style sheets to display 
the XML document content in a browser. In Chapter 17, Database Application Program- 
ming Interface (DB-API), we discuss databases, the widely employed relational database 
model and the Structured Query Language (SQL), a language used to obtain database 
contents easily. 
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16.7 Internet and World Wide Web Resources 

pyxml.sourceforge.net 

The home page for PyXML, a Python XML processing package. PyXML contains severat tools, such 
as a DOM-based and a SAX-based validating XML parsers. 

4suite.org 

The home page for 4 Sui te, a Python XML processing package. 4 Sui te contains severat DOM 
implementations for DOM-based parsing and tools for other XML-related technologies. 

www.python.org/doc/current/lib/ content-handler-obj ects.html 

This site contains documentation for xml. sax. ContentHandler event handlers. 







SUMMARY 

• Support for XML is provided through a large collection of freely available packages. 

• The process by which Python applications can generate XML dynamically is similar to that by 
which they generate XHTML. For example, to output XML from a Python script, we can use 
print statements or we can use XSLT. 

• The modules included with Python for DOM manipulation are xml .minidom and xml. pull- 
dom. However, neither of these DOM implementations is fully compliant with the W3C’s DOM 
Recommendation. 

• A third-party package called 4D0M is a fully compliant DOM implementation. 4D0M is included 
with XML package PyXML (pyxml.sourceforge.net). Once PyXML is installed, the ex- 
tended DOM components of 4D0M are accessed via xml. dom. ext. 

• 4XSLT, used for applying a style sheet to an XML document, is located in another XML package 
called 4Suite (4suite. org), from Fourthought, Inc. 

• 4D0M’s reader package includes module PyExpat. 

• PyExpat contains class Reader, an XML parser. A Reader object takes an XML document 
and parses it, storing it in memory as a tree structure (called a DOM tree). 

• The Node class, or a class derived from Node, represents an XML element, node, comment, etc. 
in an XML document. Other classes include NodeList, an ordered list of nodes, and NamedN- 
odeMap, a dictionary of attribute nodes. 

• A Document object represents the entire XML document (in memory) and provides methods for 
manipulating its data. 

• Element nodes represent XML elements. 

• Text nodes represent character data. 

• Attr nodes represent attributes in start tags. 

• Comment nodes represent comments. 

• Document nodes can contain Element, Text and Comment nodes. 

• Element nodes can contain Attr, Element, Text and Comment nodes. 

• Method f romStream accepts as input a Python file object and returns a Document object. 

• A Document objecTs documentElement attribute returns the Document’s root element 
node. 

• Function StripXml removes insignificant whitespace from an XML DOM tree. 

• A Node objecTs childNodes attribute contains a list of that Node's children. 

• A Node objecTs firstChild attribute corresponds to the first child in thatNode’s list of children. 
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• Parent nodes are obtained through the parentNode attribute. 

• Method releaseNode removes a specified Document (i.e., DOM tree) from memory. 

• Method getElementsByTagName retums a NodeList whose Element nodes have a par- 
ticular tag name. 

• A Document object’s createElement method creates an Element node. 

• Function PrettyPrint writes an XML DOM tree to a specified output stream. 

• For SAX-based parsing, programmers use a package that is included with Python (versions 2.0 and 
higher)— xml. sax . Package xml. sax contains SAX classes and functions. With SAX-based 
parsing, the parser reads the input to identify the XML markup. As the parser encounters markup, 
event handlers (i.e., methods) are called. 

• Class ContentHandler contains methods for handling SAX events. These methods can be 
overridden to perform the desired parsing. 

• The xml. sax function parse creates a SAX parser. The document passed to function parse 
may be specified as either a Python file object or a filename. The second argument passed to 
parse must be an instance of class xml. sax. ContentHandler (or a derived class of Con¬ 
tentHandler), the main callback handler in xml. sax. 

• If an enor occurs during parsing, parse raises a SAXParseException exception. 

• Methods startElement and endElement are called when element start tags and end tags are 
encountered, respectively. Method startElement takes two arguments—the element’s name 
as a string and the element’s attributes. The attributes are passed as an instance of class At- 
tributeslmpl, defined in xml. sax. reader. Method endElement executes when an el¬ 
ement’s end tag is encountered and takes the end tag’s name as an argument. 

• A 4XSLT Processor transforms XML to HTML by applying an XSLT style sheet. 

• The Processor’s appendStyleSheetStream method specifies the XSLT style sheet to 
apply. This method appends a style sheet to the list of style sheets a Processor can use. The 
argument passed to appendStyleSheetStream must be a Python file object. 

• The Processor’s runStream method applies the style sheet to the XML document. The ob¬ 
ject passed to runStream must be a Python file object. 


TERMINOLOGY 

4 DOM package 
4 Sui te package 
4XSLT package 

appendChild method of class Node 


childNodes attribute of class Node 
Comment class 
ContentHandler class 
createAttribute method of class 


appendStyleSheetNode method of class 
Processor 


Document 

createComment method of class Document 
createElement method of class Document 
createTextNode method of class 


appendStyleSheetStream method of 
class Processor 


appendStyleSheetString method of 
class Processor 


Document 

data attribute of class Comment 
data attribute of class Text 
Document class 
Document Object Model (DOM) 
DOM parser 
DOM tree 

documentElement attribute 


appendStyleSheetUri method of class 
Processor 


Attr class 

attributes attribute of class Node 


characters method of class 
ContentHandler 
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E1 ement class 

endDocument method of class 
ContentHandler 
endElement method of class 
ContentHandler 
event handler 

f irstChild attribute of class Node 
f romStream method of class Reader 
getAttribute method of class Element 
getAttributeNode method of class 
Element 

getElementsByTagName method of class 
Document 

getElementsByTagName method of class 
Element 

insertBefore method of class Node 
isSameNode method of class Node 
item method of class NamedNodeMap 
item method of class NodeList 
lastChild attribute of class Node 
length attribute of class NamedNodeMap 
length attribute of class NodeList 
name attribute of class Attr 
NamedNodeMap class 
nextSibling attribute of class Node 
Node class 
NodeList class 

nodeName attribute of class Node 
nodeType attribute of class Node 
nodeValue attribute of class Node 
parent node 

parentNode attribute of class Node 


parse function of package xml. sax 
parser 

pref ix attribute of class Attr 

PrettyPrint function of package 4DOM 

previousSibling attribute of class Node 

Processor class 

PyExpat module 

PyXML package 

Reader class 

removeAttribute method of class 
Element 

removeAttributeNode method of class 
Element 

removeChild method of class Node 
replaceChild method of class Node 
runNode method 
runStream method 
runString method 
runUri method 
SAX-based parsing 
SAX parser 

setAttribute method of class Element 
setAttributeNode method of class 
Element 

sibling 

startDocument method of class 
ContentHandler 
startElement method of class 
ContentHandler 
StripXml function of package 4DOM 
tagName attribute of class Element 
Text class 


SELF-REVIEW EXERCISES 

16.1 Fili in the blanks for each of the following statements: 

a) A PyExpat _object takes an XML document and parses it, storing it in mem- 

ory as a tree structure. 

b) A Document object’s_attribute refers to the Document's root element. 

c) 4DOM's_function prints an XML DOM tree to a specified output stream. 

d) Node method_appends a new child to the list of child nodes. 

e) Method_removes a specified DOM tree frorn memory, freeing resources. 

f) xml . sax class_contains methods for handling SAX events which can be 

overridden to perform desired parsing. 

g) A 4XSLT _ object transforms XML into HTML, by applying a specified 

XSLT style sheet. 

h) Method f romStream retums a_object. 

16.2 State which of the following statements are true and which are false. If false, explain why. 

a) To create a Python script which outputs XML, programmers use module xmlgen. 

b) Method insertBefore (a, b ) inserts node a before node b. 

c) The different XML node types are represented in a DOM tree by class XMLNode. 
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d) Node attribute childNodes returns a NodeList object containing the node’s chil- 
dren. 

e) 4DOM's StripXml function parses an XML document. 

f) With SAX-based parsing, the parser reads the input, storing it in memory as a tree struc¬ 
ture. 

g) The second argument passed to parse must be an instance of class xml. sax. Con- 
tentHandler (or a subclass of ContentHandler). 

h) If an error occurs while parsing a file, parse raises a SAXParseException excep- 
tion. 


ANSWERS TO SELF-REVIEW EXERCISES 

16.1 a) Reader. b) documentElement. c) PrettyPrint. d) appendChild. 
e) releaseNode. f) ContentHandler. g) Processor. h) Document. 

16.2 a) False. Programmers can use print statements, XSLT or the DOM to generate XML 
markup. b) True. c) False. XML node types are represented by classes derived from Node, d) True. 
e) False. StripXml removes insignificant whitespace from an XML DOM tree. f) False. With SAX- 
based parsing, data is not stored in memory. As the parser encounters markup, event handlers are 
called. g) True. h) True. 

EXERCISES 

16.3 Modify the program in Fig. 16.13. Allow the user to add a new element to each contact 
element. For instance, if the user adds a phoneNumber element, the user should be prompted to pro¬ 
vide a phone number for each contact. Each time a user adds a contact, the user should be prompted 
to provide information for any new elements in addition to the first and last names. Function print - 
List should print any new information as well as the contact’s first and last names. 

16.4 Create a Python script that, given an XML document, creates an XHTML list of the docu¬ 
ment’s elements in hierarchical order. Display the elements in Internet Explorer. For example, given 
the XML document in Fig. 16.29, create a Python script that lists the elements as shown in Fig. 16.29. 

16.5 These lines of code are from lines 45—46 of formatting.xsl (Fig. 16.27). Explain why 
the @ in front of "@f ile" is necessary in the xsl: value-of element. 

<xsl:attribute name = > ../cgi-bin/ 

addPost.py?file=<xsl :value-of select = /> 

</xsl:attribute> 

16.6 Describe the purpose of Fig. 16.27 (formatting.xsl). 

16.7 Implement the Delete a Forum option in default .py. Selecting this option should di- 
rect the user to a script named deleteForum.py. Here, the user can select a forum name from a 
list. Your script should remove the selected forum from forums.xml and delete the underlying 
XML document. After removing the forum, the script should redirect the browser to default. py. 



1 

<?xml version = "1.0"?> 



2 

<?xml:stylesheet type = t/xsl 

href = "gam 

es.xs ?> 

3 




4 

<!-- Fig. 16.29 

- - > 


5 

<!-- Sports Database: sports.xml 

- - > 









Fig. 16.29 sports .xml forExercise 16.4. (Part 1 of 2.) 
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9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 


<sports> 

<game id = > 

<name>Cricket</name> 

<summary> 

<paragraph> 

More popular among commonwealth nations. 

</paragraph> 

</summary> 

</game> 

<game id = "239' > 

<name:>Baseball</name> 

<summary> 

<paragraph> 

More popular in America. 

</paragraph> 

</summary> 

</game> 

</sports> 





Fig. 16.29 sports . xml for Exercise 16.4. (Part 2 of 2.) 

16.8 Implement the Modify a Forum option in def ault .py such that individual messages can 
be deleted. Selecting this option should direct the user to a script named modi f yForum. py. Here, 
the user can select a forum name from a list. Script modi f yForum. py should then display ali the 
messages in the specified forum, allowing the user to select one for deletion. Once selected, modi - 
f yForum. py should remove the given message from the current forum and redirect the browser to 
def ault. py. 
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Objectives 

• To understand the reladonal database model. 

• To understand basic database queries using Structured 
Query Language (SQL). 

• To use the methods of the MySQLdb module to query 
a database, insert data into a database and update data 
in a database. 

It is a capital mistake to theorize before one has data. 
Arthur Conan Doyle 

Now go, write it before them in a table, and note it in a book, 
that it may befor the time to come for ever and ever. 

The Holy Bible: The Old Testament 
Let's look at the record. 

Alfred Emanuel Smith 

True art selects and paraphrases, but seldom gives a 
verbatim translation. 

Thomas Bailey Aldrich 

Get your facts first, and then you can distort them as much 
as you please. 

Mark Twain 

I like two kinds ofmen: domestic and foreign. 

Mae West 







HS 
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Outline 

17.1 Introduction 

17.2 Relational Database Model 

17.3 Relational Database OverView: Books Database 

17.4 Structuied Query Language (SQL) 

17.4.1 Basic SELECT Query 

17.4.2 WHERE Clause 

17.4.3 ORDER BY C lause 

17.4.4 Meiging Data fiom Multiple lables: INNER JOIN 

17.4.5 Joining Data fromlables Authors, AuthorISBN, 
Tities and Publishers 

17.4.6 INSERT Statement 

17.4.7 UPDATE Statement 

17.4.8 DELETE Statement 

17.5 Python DB-API Specification 

17.6 Database Query Example 

17.7 Queiying the Books Database 

17.8 Reading, Inserting and Updating a Database 

17.9 Internet and World Wde Web Resources 

Summary • Terminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 


17.1 Introduction 

In Chapter 14, File Processing and Serialization, we discussed sequential-access and ran- 
dom-access file processing. Sequential-file processing is appropriate for applications in 
which most or ali of the file’s information is to be processed. On the other hand, random- 
access file processing is appropriate for applications in which only a small portion of a 
file’s data is to be processed. For instance, in transaction processing it is crucial to locate 
and, possibly, update an individual piece of data quickly. Python provides capabilities for 
both types of file processing. 

A database is an integrated collection of data. Many companies maintain databases to 
organize employee information, such as names, addresses and phone numbers. There are 
many different strategies for organizing data to facilitate easy access and manipulation of 
the data. A database management system (DBMS) provides mechanisms for storing and 
organizing data in a manner consistent with the database’s format. Database management 
systems allow for the access and storage of data without concern for the internal represen- 
tation of databases. 

Today’s most popular database systems are relational databases, which store data in 
tables and define relationships between the tables. A language called Structured Query 
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Language (SQL —pronounced as its individual letters or as “sequel”) is used almost univer- 
sally with relational database systems to perform queries (i.e., to request information that 
satisfies given criteria) and to manipulate data. [Note: The writing in this chapter assumes 
that SQL is pronounced as its individual letters. For this reason, we often precede SQL with 
the article “an” as in “an SQL database” or “an SQL statement.”] 

Some popular relational database systems include Microsoft SQL Server, Oracle, 
Sybase, DB2, Informix and MySQL. In this chapter, we present examples using MySQL. 
All examples in this chapter use MySQL version 3.23.41. [Note: The Deitel & Associates, 
Inc. Web site (www.deitel.com) provides step-by-step instructions for installing 
MySQL and helpful MySQL commands for creating, populating and deleting tables.] 

A programming language connects to, and interacts with, relational databases via an 
interface —Software that facilitates Communications between a database management 
system and a program. Python programmers communicate with databases using modules 
that conform to the Python Database Application Programming Interface (DB-API). 
Section 17.5 discusses the DB-API specification. 

17.2 Relational Database Model 

The relational database model is a logical representation of data that allows relationships 
among data to be considered without concern for the physical structure of the data. A rela¬ 
tional database is composed of tables. Figure 17.1 illustrates a table that might be used in 
a personnel system. The table name is Employee, and its primary purpose is to maintain 
the specific attributes of various employees. A particular row of the table is called a record 
(or row). This table consists of six records. The number field (or columri) of each record 
in the table is the primary key for referencing data in the table. A primary key is a field (or 
combination of fields) in a table that contain(s) unique data—i.e, data that is not duplicated 
in other records of that table. This guarantees that each record can be identified by at least 
one distinet value. Examples of primary-key fields are columns that contain social security 
numbers, employee IDs and part numbers in an inventory system. The records of Fig. 17.1 
are ordered by primary key. In this case, the records are listed in increasing order (they also 
could be listed in decreasing order). 


Record/Row 


Number 

Name 

Department 

Salary 

Location 

23603 

J ones 


413 


1100 

New J ersey 

24568 

Kerwin 


413 


2000 

New J ersey 

34589 

Larson 


642 


1800 

LosAngeles 

35761 

Myers 


611 


1400 

Oriando 

47132 

Neumann 


413 


9000 

New J ersey 

78321 

Stephens 


611 


8500 

Oriando 


Prima ry key 


Field/Column 


Fig. 17.1 Relational-database structure of an Employee table. 














































pythonhtpl_17.fm Page 572 Wednesday, December 19, 2001 2:46 PM 





572 Database Application Programming Interface (DB-API) Chapter 17 




Each column of the table represents a different field. Records normally are unique (by 
primary key) within a table, but particular field values might be duplicated in multiple 
records. For example, three different records in the Employee table’s Department field 
contain the number 413. 

Often, different users of a database are interested in different data and different relation- 
ships among those data. Some users require only subsets of the table columns. To obtain table 
subsets, we use SQL statements to specify certain data we wish to select from a table. SQL 
provides a complete set of commands (including SELECT) that enable programmers to define 
complex queries to select data from a table. The results of queries commonly are called resuit 
sets (or record sets). For example, we might select data from the table in Fig. 17.1 to create a 
new resuit set that contains only the location of each department. This resuit set appears in 
Fig. 17.2. SQL queries are discussed in detail in Section 17.4. 


17.3 Relational Database OverView: Books Database 


This section gives an overview of SQL in the context of a sample Books database we cre- 
ated for this chapter. Before we discuss SQL, we overview the tables of the Books data¬ 
base. [Note: The CD that accompanies this book contains a program called DBSetup. py 
that creates and populates a Books database with sample data.] 

We use the Books database to introduce various database concepts, such as using 
SQL to obtain useful information from the database and to manipulate the database. We 
provide the database in the examples directory for this chapter on the CD that accompanies 
this book. Note that when using MySQL on Windows, the database name is case insensitive 
(i.e., the Books database and the books database refer to the same database). However, 
on Linux, the database name is case sensitive (i.e., the Books database and the books 
database refer to different databases). 

The database consists of four tables: Authors, Publishers, AuthorISBN and 
Tities. The Authors table (described in Fig. 17.3) consists of three fields (or columns) 
that maintain each author’s unique ID number, first name and last name. Figure 17.4 con¬ 
tains the sample data from the Authors table of the Books database. 

The Publishers table (described in Fig. 17.5) consists of two fields, which repre- 
sent each publisher’s unique ID and name. Figure 17.6 contains the data from the Pub¬ 
lishers table of the Books database. 


Department 

Location 

413 

New J ereey 

611 

Oriando 

642 

LosAngeles 


Fig. 17.2 Resuit set formed byselecting Department and Locationdata 
from the Employee table. 
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Field 

Descriptiori 


AuthorlD Author’s ID number in the database. In the Books database, this int field is 

defined as an auto-incrementedfield. For each new record inserted in this table, 
the database increments the AuthorlD value, ensuring that each record has a 
unique AuthorlD. This field is the table’s primary key. 

FirstName Author's first name (a string). 

LastName Author’s last name (a string). 

Fig. 17.3 Authors table from Books. 

AuthorlD 

FirstName 

LastName 

i 

Harvey 

Deitel 

2 

Paul 

Deitel 

3 

Tem 

Nieto 

4 

Kate 

Steinbuhler 

5 

Sean 

Santry 

6 

Ted 

Lin 

7 

Praveen 

Sadhu 

8 

David 

McPhie 

9 

Cheryl 

Yaeger 

10 

Marina 

Zlatkina 

11 

Ben 

Wiedermann 

12 

Jonathan 

Liperi 

13 

Jeffrey 

Listfield 

Fig. 17.4 Data from the Authors table of Books. 

Field 

Descriptiori 


PublisherlD The publisher’s ID number in the database. This auto-incremented int 


field is the table’s primary-key field. 


PublisherName The name of the publisher (a string). 



Fig. 17.5 Publishers table from Books. 


The AuthorISBN table (described in Fig. 17.7) consists of two fields that maintain 
the authors’ ID numbers and the corresponding ISBN numbers of their books. This table 
helps associate the names of the authors with the tities of their books. Figure 17.8 con- 
tains a portion of the sample data from the AuthorISBN table of the Books database. 
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ISBN is an abbreviation for “International Standard Book Number”—a numbering 
scheme by which publishers worldwide assign every book a unique Identification 
number. [Note: To save space, we split the contents of this figure into two columns, each 
containing the AuthorlD and ISBN fields.] 


PublisherlD 


PublisherName 


1 Prentice Hali 

2 Prentice Hali PTG 


Fig. 17.6 Data fromthe Publishers table ofBooks. 

Field Descriptiori 

AuthorlD The author’s ID number, which allows the database to associate each 

book with a specific author. The integer ID number in this field must 
also appear in the Authors table. 

ISBN The ISBN number for a book (a string). 






Fig. 17.7 AuthorISBN table from Books. 


AuthorlD 

ISBN 

AuthorlD 

ISBN 



i 

0130895725 

i 

0130284181 

i 

0132261197 

i 

0130895601 

i 

0130895717 

2 

0130895725 

i 

0135289106 

2 

0132261197 

i 

0139163050 

2 

0130895717 

i 

013028419x 

2 

0135289106 

i 

0130161438 

2 

0139163050 

i 

0130856118 

2 

013028419x 

i 

0130125075 

2 

0130161438 

i 

0138993947 

2 

0130856118 

i 

0130852473 

2 

0130125075 

i 

0130829277 

2 

0138993947 

i 

0134569555 

2 

0130852473 

i 

0130829293 

2 

0130829277 

i 

0130284173 

2 

0134569555 


Fig. 17.8 Data from AuthorISBN table in Books. [Note: This table showsonly a 
portio n of the sample data.] 
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AuthorlD 

ISBN 

AuthorlD 

ISBN 

2 

0130829293 

3 

0130856118 

2 

0130284173 

3 

0134569555 

2 

0130284181 

3 

0130829293 

2 

0130895601 

3 

0130284173 

3 

013028419x 

3 

0130284181 

3 

0130161438 

4 

0130895601 


Fig. 17.8 Data from AuthorISBN table in Books. [Note: This table showsonly a 
portion of the sample data.] 

The Tities table (describet! in Fig. 17.9) consists of seven fields that maintain gen- 
eral information about the books in the database. This information includes each book’s 
ISBN number, title, edition number, Copyright year and publisher’s ID number, as well as 
the name of a file that contains an image of the book cover and, finally, each book’s price. 
Figure 17.10 contains the sample data from the Tities table. 




field 

ISBN 

Title 

EditionNumber 

Copyright 

PublisherlD 

ImageFile 

Price 


Descriptiori 



ISBN number of the book (a string). 

Title of the book (a string). 

Edition number of the book (a string). 

Copyright year of the book (an int). 

Publisher's ID number (an int). This value must correspond to an ID 
number in the Publishers table. 

Name of the file containing the books cover image (a string). 
Suggested retail price of the book (a real number). [ Note : The prices 
shown in this database are for example purposes only.] 


Fig. 17.9 Tities table from Books. 




Edition- 

Publish¬ 

Copy¬ 



ISBN 

Title 

Number 

erlD 

right 

ImageFile 

Price 


0130923613 

Python How to Pro- 

i 

i 

2002 

python.jpg 

$69.95 


gram 






0130622214 

C# How to Program 

i 

i 

2002 

cshtp.jpg 

$69.95 

0130341517 

Java How to Pro- 

4 

i 

2002 

jhtp4.jpg 

$69.95 


gram 








Fig. 17.10 Data from the Tities table of Books. (Part 1 of 3.) 




































pythonhtpl_17.fm Page 576 Wednesday, December 19, 2001 2:46 PM 






576 Database Application Programming Interface (DB-API) Chapter 17 






Edition- 

Publish- 

Copy¬ 


ISBN 

Title 

Number 

erlD 

right ImageFile 

Price 


0130649341 

The Complete Java 
Training Course 

4 

2 

2002 

j avactc4.jpg 

$109.95 

0130895601 

Advanced Java 2 

Platform How to 
Program 

1 

1 

2002 

advjhtpl.jpg 

$69.95 

0130308978 

Internet and World 

Wide Web How to 
Program 

2 

1 

2002 

iw3htp2.jpg 

$69.95 

0130293636 

Visual Basic .NET 
How to Program 

2 

1 

2002 

vbnet.jpg 

$69.95 

0130895636 

The Complete C++ 
Training Course 

3 

2 

2001 

cppctc3.jpg 

$109.95 

0130895512 

The Complete e- 

1 

2 

2001 

ebecctc.jpg 

$109.95 


Business & e-Com- 
merce Program¬ 
ming Training 
Course 


013089561X 

The Complete Inter¬ 
net & World Wide 
Web Programming 
Training Course 

2 

2 

2001 

iw3ctc2.jpg 

$109.95 

0130895547 

The Complete Perl 
Training Course 

1 

2 

2001 

peri.jpg 

$109.95 

0130895563 

The Complete XML 
Programming Train¬ 
ing Course 

1 

2 

2001 

xmlctc.jpg 

$109.95 

0130895725 

C How to Program 

3 

1 

2001 

chtp3.jpg 

$69.95 

0130895717 

C++ How to Pro¬ 
gram 

3 

1 

2001 

cpphtp3.jpg 

$69.95 

013028419X 

e-Business and e- 

1 

1 

2001 

ebechtpl.jpg 

$69.95 


Commerce How to 
Program 



0130622265 Wireless Internet 1 1 2001 wireless.jpg $69.95 

and Mobile Busi¬ 
ness How to Pro¬ 
gram 


0130284181 

Perl How to Pro- 1 

gram 

i 

2001 

perlhtpl.jpg 

$69.95 

0130284173 

XML How to Pro- 1 

gram 

i 

2001 

xmlhtpl.jpg 

$69.95 

0130856118 

The Complete Inter- 1 
net and World Wide 

2 

2000 

iw3ctcl.jpg 

$109.95 


Web Programming 
Training Course 








Fig. 17.10 Data from the Tities table of Books. (Part 2 of 3.) 
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Edition- 

Publish- 

Copy¬ 


ISBN 

Title 

Number 

erlD 

right ImageFile 

Price 


0130125075 

Java How to Pro- 
gram (Java 2) 

3 

1 

2000 

jhtp3.jpg 

$69.95 

0130852481 

The Complete Java 

2 Training Course 

3 

2 

2000 

j avactc3.jpg 

$109.95 

0130323640 

e-Business and e- 

Commerce for 
Managers 

1 

1 

2000 

ebecm.jpg 

$69.95 

0130161438 

Internet and World 

Wide Web How to 
Program 

1 

1 

2000 

iw3htpl.jpg 

$69.95 

0130132497 

Getting Started 
with Visual C++ 6 

with an Introduc- 

tion to MFC 

1 

1 

1999 

gsvc.jpg 

$49.95 

0130829293 

The Complete 

Visual Basic 6 
Training Course 

1 

2 

1999 

vbctcl.jpg 

$109.95 

0134569555 

Visual Basic 6 How 
to Program 

1 

1 

1999 

vbhtpl.jpg 

$69.95 

0132719746 

Java Multimedia 
Cyber Classroom 

1 

2 

1998 

j avactc.jpg 

$109.95 

0136325890 

Java How to Pro¬ 
gram 

1 

1 

1998 

jhtpl.jpg 

$69.95 

0139163050 

The Complete C++ 
Training Course 

2 

2 

1998 

cppctc2.jpg 

$109.95 

0135289106 

C++ How to Pro¬ 
gram 

2 

1 

1998 

cpphtp2.jpg 

$49.95 

0137905696 

The Complete Java 
Training Course 

2 

2 

1998 

j avactc2.jpg 

$109.95 

0130829277 

The Complete Java 
Training Course 
(Java 1.1) 

2 

2 

1998 

j avactc2.jpg 

$99.95 

0138993947 

Java How to Pro¬ 
gram (Java 1.1) 

2 

1 

1998 

jhtp2.jpg 

$49.95 

0131173340 

C++ How to Pro¬ 
gram 

1 

1 

1994 

cpphtpl.jpg 

$69.95 

0132261197 

C How to Program 

2 

1 

1994 

chtp2.jpg 

$49.95 

0131180436 

C How to Program 

1 

1 

1992 

chtp.jpg 

$69.95 



Fig. 17.10 Data from the Tities table of Books. (Part3of 3.) 

Figure 17.11 illustrates the relationships among the tables in the Books database. The 
first line in each table is the table’ s name. The field whose name appears in italics contains 
that table’s primary key. A table’s primary key uniquely identifies each record in the table. 
Every record must have a value in the primary-key field, and the value must be unique. This 
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Fig. 17.11 Table relationshipsin Books. 







is known as the Rule ofEntity Integrity. Note that the AuthorISBN table contains two 
fields whose names are italicized. This indicates that these two fields form a compoundpri- 
mary key —each record in the table must have a unique AuthorID-ISBN combination. 
For example, several records might have an AuthorlD of 2, and several records might 
have an ISBN of 013 0 8 95601, but only one record can have both an AuthorlD of 2 


and an ISBN of 0130895601. 

Common Programming Error 17.1 



Failure to provide a value for a primary-key field in everv record breaks the Rule ofEntity 
Integrity and causes the DBMS to report an error. 



Common Programming Error 17.2 


Providing duplicate valuesfor the primary-key field of multiple records causes the DBMS to 
report an error. 


The lines connecting the tables in Fig. 17.11 represent the relationships among the 
tables. Consider the line between the Publishers and Tities tables. On the Pub- 
lishers end of the line, there is a 1, and, on the Tities end, there is an infinity (»>) 
symbol. This line indicates a one-to-many relationship, in which every publisher in the 
Publishers table can have an arbitrarily large number of books in the Tities table. 
Note that the relationship line links the PublisherlD field in the Publishers table to 
the PublisherlD field in Tities table. In the Tities table, the PublisherlD field 
is a foreign key —a field for which every entry has a unique value in another table and where 
the field in the other table is the primary key for that table (e.g., PublisherlD in the 
Publishers table). Programmers specify foreign keys when creating a table. The for¬ 
eign key helps maintain the Rule of Referential Integrity. Every foreign-key field value 
must appear in another table’s primary-key field. Foreign keys enable information from 
multiple tables to be joined together for analysis purposes. There is a one-to-many relation¬ 
ship between a primary key and its corresponding foreign key. This means that a foreign- 
key field value can appear many times in its own table, but must appear exactly once as the 
primary key of another table. The line between the tables represents the link between the 
foreign key in one table and the primary key in another table. 
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Common Programming Error 17.3 



Providing aforeign-key value that does not appear as a primary-key value in another table 
breaks the Ride of Referential Integrity and causes the DBMS to report an error. 


The line between the AuthorISBN and Authors tables indicates that, for each 
author in the Authors table, the AuthorISBN table can contain an arbitrary number of 
ISBNs for books written by that author. The AuthorlD field in the AuthorISBN table 
is a foreign key of the AuthorlD field (the primary key) of the Authors table. Note, 
again, that the line between the tables links the foreign key in table AuthorISBN to the 
corresponding primary key in table Authors. The AuthorISBN table links information 
in the Tities and Authors tables. 

The line between the Tities and AuthorISBN tables illustrates another one-to- 
many relationship; a title can be written by any number of authors. In fact, the sole purpose 
of the AuthorISBN table is to represent a many-to-many relationship between the 
Authors and Tities tables; an author can write any number of books, and a book can 
have any number of authors. 




17.4 Structured Query Language (SQL) 

This section provides an overview of Structured Query Language (SQL) in the context of 
our Books sample database. The SQL queries discussed here form the foundation for the 
SQL used in the chapter examples. 

Figure 17.12 lists SQL keywords and provides a description of each. In the next sev- 
eral subsections, we discuss these SQL keywords in the context of complete SQL queries. 
Other SQL keywords exist, but are beyond the scope of this text. [Note: To locate additional 
information on SQL, please refer to the bibliography at the end of this chapter.] 


SQL keyword 

Description 

SELECT 

Selects (retrieves) fields from one or more tables. 

FROM 

Specifies tables from which to get fields or delete records. Required 
in every SELECT and DELETE statement. 

WHERE 

Specifies criteria that determine the rows to be retrieved. 

INNER JOIN 

Joins records from multiple tables to produce a single set of records. 

GROUP BY 

Specifies criteria for grouping records. 

ORDER BY 

Specifies criteria for ordering records. 

INSERT 

Inserts data into a specified table. 

UPDATE 

Updates data in a specified table. 

DELETE 

Deletes data from a specified table. 








Fig. 17.12 SQL query keywords. 
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17.4.1 Basic SELECT Query 

Let us consider several SQL queries that extract information from database Books. A typ- 
ical SQL query “selects” information from one or more tables in a database. Such selections 
are performed by SELECT queries. The basic format for a SELECT query is: 

SELECT * FROM tableName 

In this query, the asterisk (*) indicates that all columns from the tableName table of the da¬ 
tabase should be selected. For example, to select the entire contents of the Authors table 
(i.e., all data depicted in Fig. 17.4), use the query: 

SELECT * FROM Authors 


To select specific fields from a table, replace the asterisk (*) with a comma-separated 
list of the field names to select. For example, to select only the fields AuthorlD and 
LastName for all rows in the Authors table, use the query: 


SELECT AuthorlD, LastName FROM Authors 


This query returns only the data presented in Fig. 17.13. The resuit set contains the columns 
in the order that are specified by the query. [Note: If a field name contains spaces, the entire 
field name must be enclosed in square brackets ([]) in the query. For example, if the field 
name is First Name, it must appear in the query as [First Name] ]. 


Common Programming Error 17.4 



If a program assumes that an SQL statement using the asterisk (*) to select fields always re¬ 
turns those fields in the same order, the program could process the resuit set incorrectly. If 
the field order in the database table(s) changes, the order of the fields in the resuit set would 
change accordingly. 



Performance Tip 17.1 

1 If a program does not know the order of fields in a resuit set, the program must process the 
fields by name. This could require a linear search of the field names in the resuit set. Ifusers 
specify the field names thatthey wish to select from a table {or several tables), the application 
receiving the resuit set knows the order of the fields in advance. When this occurs, the pro¬ 
gram can process the data more efficiently, because fields can be accessed directly by col- 
umn number. 


AuthorlD 

LastName 

AuthorlD 

LastName 

1 

Deitel 

8 

McPhie 

2 

Deitel 

9 

Yaeger 

3 

Nieto 

10 

Zlatkina 

4 

Steinbuhler 

12 

Wiedermann 

5 

Santry 

12 

Liperi 

6 

Lin 

13 

Listfield 

7 

Sadhu 










Fig. 17.13 AuthorlD and LastName from the Authors table. 
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17.4.2 WHERE Clause 

In most cases, users search a database forrecords that satisfy certain selection criteria. Only 
records that match the selection criteria are selected. SQL uses the optional WHERE clause 
in a SELECT query to specify the selection criteria for the query. The simplest format for 
a SELECT query that includes selection criteria is: 

SELECT fieldNamel, fielclName2, ... FROM tableName WHERE criteria 

For example, to select the Title, EditionNumber and Copyright fields from those 
rows of table Tities in which the Copyright date is greater than 199 9, use the query: 


SELECT Title, EditionNumber, Copyright 
FROM Tities 

WHERE Copyright > 1999 


Figure 17.14 shows the resuit set of the preceding query. [Note: When we construet a query 
for use in Python, we create a string containing the entire query. However, when we display 
queries in the text, we often use multiple lines and indentation to enhance readability.] 



Performance Tip 17.2 

Using selection criteria improves performance, because queries that involve such criteria 
normally select a portion ofthe database that is smaller than the entire database. Working 
with a smaller portion ofthe data is more efficient than working with the entire set of data 
stored in the database. 


Title 

EditionNumber 

Copyright 

Internet and World Wide Web How to Program 

2 

2002 

Java How to Program 

4 

2002 

The Complete Java Training Course 

4 

2002 

The Complete e-Business & e-Commerce Program¬ 
ming Training Course 

1 

2001 

The Complete Internet & World Wide Web Program¬ 
ming Training Course 

2 

2001 

The Complete Perl Training Course 

1 

2001 

The Complete XML Programming Training Course 

1 

2001 

C How to Program 

3 

2001 

C++ How to Program 

3 

2001 

The Complete C++ Training Course 

3 

2001 

e-Business and e-Commerce How to Program 

1 

2001 

Internet and World Wide Web How to Program 

1 

2000 

The Complete Internet and World Wide Web Program¬ 
ming Training Course 

1 

2000 

Java How to Program (Java 2) 

3 

2000 






Fig. 17.14 Tities with copyrightsafter 1999 from table Tities. (Part 1 of 2.) 
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Title EditionNumber Copyright 


The Complete Java 2 Training Course 

3 

2000 

XML How to Program 

1 

2001 

Perl How to Program 

1 

2001 

Advanced Java 2 Platform How to Program 

1 

2002 

e-Business and e-Commerce for Managers 

1 

2000 

Wireless Internet and Mobile Business How to Program 

1 

2001 

C# How To Program 

1 

2002 

Python How to Program 

1 

2002 

Visual Basic .NET How to Program 

2 

2002 






Fig. 17.14 Tities with copyrightsafter 1999 from table Tities. (Part 2 of 2.) 

The WHERE clause conditioncan contain operators <, >,<=,>=,=,<> and LIKE. Oper¬ 
ator LIKE is used for paltem matcliing with wildcard characters percent (%) and underscore 
mark (_). Pattern matching allows SQL to search for strings that “match a pattern.” 

A pattern that contains a percent (%) searches for strings in which zero or more char¬ 
acters take the percent character’s place in the pattern. For example, the following query 
locates the records of ali authors whose last names start with the letter D: 


SELECT AuthorlD, FirstName, LastName 
FROM Authors 

WHERE LastName LIKE 1 D%' 


The preceding query selects the two records shown in Fig. 17.15, because two of the au¬ 
thors in our database have last names that begin with the letter D (followed by zero or more 
characters). The % in the WHERE clause’s LIKE pattern indicates that any number of char¬ 
acters can appear after the letter D in the LastName field. Notice that the pattern string is 
surrounded by single-quote characters. 



Portability Tip 17.1 

Not all database systems support the LIKE operator, so be sure to read the database Sys¬ 
tem’s documentation carefully before employing this operator. 



Portability Tip 17.2 

Some databases use the * character in place ofthe % character in LIKE expressions. 


AuthorlD 

FirstName 

LastName 

i 

Harvey 

Deitel 

2 

Paul 

Deitel 


Fig. 17.15 Authotsfrom the Authors table whose Ia st names start with D. 
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Portability Tip 17.3 

In some databases , string data is case sensitive. 



Portability Tip 17.4 

In some databases, table natnes andfield names are case sensitive. 



Good Programming Practice 17.1 

By convention, SQL keywords should be written entirely in uppercase letters on systems that 
are not case sensitive. This emphasizes the SQL keywords in an SQL statement. 


A pattern string including an underscore (_) character searches for strings in which 
exactly one character takes the underscore’s place in the pattern. For example, the fol- 
lowing query locates the records of all authors whose last names start with any character 
(specified with _), followed by the letter i, followed by any number of additional charac- 
ters (specified with %): 


SELECT AuthorlD, FirstName, LastName 
FROM Authors 

WHERE LastName LIKE ' i%' 


The preceding query produces the records listed in Fig. 17.16; five authors in our database 
have last names in which the letter i is the second letter. 

Portability Tip 17.5 

Some databases use the ? character in place ofthe _ character in LIKE expressions. 



17.4.3 ORDER BY Clause 

The results of a query can be arranged in ascending or descending order using the optional 
ORDER BY clause. The simplest forms for an ORDER BY clause are: 

SELECT fieldNamel, fieldName2, ... FROM tableName ORDER BY field ASC 
SELECT fieldNamel, fieldName2, ... FROM tableName ORDER BY field DESC 

where ASC specifies ascending order (lowest to highest), DESC specifies descending order 
(highest to lowest) and field specifies the field whose values determine the sorting order. 


AuthorlD 

FirstName 

LastName 

3 

Tem 

Nieto 

6 

Ted 

Lin 

11 

Ben 

Wiedermann 

12 

Jonathan 

Liperi 

13 

Jeffrey 

Listfield 


Fig. 17.16 Authorsfrom table Authors whose lastnamescontain i asthe second 
letter. 
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For example, to obtain a list of authors arranged in ascending order by last name 
(Fig. 17.17), use the query: 

SELECT AuthorlD, FirstName, LastName 

FROM Authors 

ORDER BY LastName ASC 

Note that the default sorting order is ascending; therefore, ASC is optional. 

To obtain the same list of authors arranged in descending order by last name 
(Fig. 17.18), use the query: 

SELECT AuthorlD, FirstName, LastName 

FROM Authors 

ORDER BY LastName DESC 







AuthorlD 

FirstName 

LastName 

2 

Paul 

Deitel 

1 

Harvey 

Deitel 

6 

Ted 

Lin 

12 

Jonathan 

Liperi 

13 

Jeffrey 

Listfield 

8 

David 

McPhie 

3 

Tem 

Nieto 

7 

Praveen 

Sadhu 

5 

Sean 

Santry 

4 

Kate 

Steinbuhler 

11 

Ben 

Wiedermann 

9 

Cheryl 

Yaeger 

10 

Marina 

Zlatkina 

Fig. 17.17 

Authors from table Authors in ascending orderby LastName. 


AuthorlD 

FirstName 

LastName 

10 

Marina 

Zlatkina 

9 

Cheryl 

Yaeger 

11 

Ben 

Wiedermann 

4 

Kate 

Steinbuhler 

5 

Sean 

Santry 


Fig. 17.18 Authorsfrom table Authors in descending orderby LastName. (Part 
1 of 2.) 
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AuthorlD 

FirstName 

LastName 

7 

Praveen 

Sadhu 

3 

Tem 

Nieto 

8 

David 

McPhie 

13 

Jeffrey 

Listfield 

12 

Jonathan 

Liperi 

6 

Ted 

Lin 

2 

Paul 

Deitel 

1 

Harvey 

Deitel 

Fig. 17.18 Authorsfrom table Authors in descending orderby LastName. (Part 

2 of 2.) 



The ORDER BY clause also can be used to order records by multiple fields. Such que- 

ries are written in the form: 


ORDER BY fieldl sortingOrder , field2 sortingOrder, 


where sortingOrdei 

r is either ASC or DESC. Note that the sortingOrder does not have to be 

identical for each field. For example, the query: 


SELECT AuthorlD, FirstName, LastName 
FROM Authors 


ORDER BY 

LastName, FirstName 


sorts all authors in ascending order by last name, then by first name. Thus, any authors have 

the same last name, 

their records are returned sorted by first 

name (Fig. 17.19). 

AuthorlD 

FirstName 

LastName 

i 

Harvey 

Deitel 

2 

Paul 

Deitel 

6 

Ted 

Lin 

12 

Jonathan 

Liperi 

13 

Jeffrey 

Listfield 

8 

David 

McPhie 

3 

Tem 

Nieto 

7 

Praveen 

Sadhu 

5 

Sean 

Santry 

4 

Kate 

Steinbuhler 


(«) 




Fig. 17.19 Authorsfrom table Authors in ascending orderby LastName and by 
FirstName. (Part 1 of 2.) 
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AuthorlD 

FirstName 

LastName 

11 

Ben 

Wiedermann 

9 

Cheryl 

Yaeger 

10 

Marina 

Zlatkina 




Fig. 17.19 Authorsfrom table Authors in ascending orderby LastName and by 
FirstName. (Part 2 of 2.) 

The WHERE and ORDER BY clauses can be combined in one query. For example, the 
query: 

SELECT ISBN, Title, EditionNumber, Copyright, Price 
FROM Tities 
WHERE Title 

LIKE '*How to Program' ORDER BY Title ASC 

returns the ISBN, title, edition number, Copyright and price of each book in the Tities 
table that has a Title ending with “How to Program;" it lists these records in ascending 
order by Title. The results of the query are depicted in Fig. 17.20. 



ISBN 

Title 

Edition¬ 

Number 

Copy¬ 

right 

Price 

0130895601 

Advanced Java 2 Platform 
How to Program 

1 

2002 

S69.95 

0131180436 

C How to Program 

1 

1992 

$69.95 

0130895725 

C How to Program 

3 

2001 

$69.95 

0132261197 

C How to Program 

2 

1994 

$49.95 

0130622214 

C# How To Program 

1 

2002 

$69.95 

0135289106 

C++ How to Program 

2 

1998 

$49.95 

0131173340 

C++ How to Program 

1 

1994 

$69.95 

0130895717 

C++ How to Program 

3 

2001 

$69.95 

013028419X 

e-Business and e-Commerce 
How to Program 

1 

2001 

$69.95 

0130308978 

Internet and World Wide 

Web How to Program 

2 

2002 

$69.95 

0130161438 

Internet and World Wide 

Web How to Program 

1 

2000 

$69.95 

0130341517 

Java How to Program 

4 

2002 

$69.95 

0136325890 

Java How to Program 

1 

1998 

$49.95 


Fig. 17.20 Booksfrom table Tities whose titlesend with How to Program in 
ascending orderby Title. (Part 1 of 2.) 
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ISBN 

Title 

Edition- 

Number 

Copy¬ 

right 

Price 

0130284181 

Perl How to Program 

i 

2001 

$69.95 

0130923613 

Python How to Program 

i 

2002 

$69.95 

0130293636 

Visual Basic .NET How to 
Program 

2 

2002 

$69.95 

0134569555 

Visual Basic 6 How to 
Program 

1 

1999 

$69.95 

0130622265 

Wireless Internet and Mobile 
Business How to Program 

1 

2001 

$69.95 

0130284173 

XML How to Program 

1 

2001 

$69.95 


Fig. 17.20 Booksfrom table Tities whose titlesend with How to Program in 
ascending orderby Titi e. (Part 2 of 2.) 


17.4.4 Meiging Data ftom Multiple Tables: INNER JOIN 

Database designers often split related data into separate tables to ensure that a database does 
not store data redundantly. For example, the Books database has tables Authors and 
Tities. We use an AuthorISBN table to provide “links” between authors and their cor- 
responding tities. If we did not separate this information into individual tables, we would 
need to include author information with each entry in the Tities table. This would resuit 
in the database storing duplicate author information for authors who wrote multiple books. 

Often, it is necessary for analysis purposes to merge data from multiple tables into a 
single set of data—referred to as joining the tables. Joining is accomplished via an INNER 
JOIN operation in the SELECT query. An INNER JOIN merges records from two or more 
tables by testing for matching values in a field that is common to the tables. The simplest 
format for an INNER JOIN clause is: 

SELECT fieldNamel, fieldName2, ... 

FROM tablel 
INNER JOIN table2 

ON tablel .fleldName = table2 .fieldName 

The ON part of the INNER JOIN clause specifies the fields from each table that are com- 
pared to determine which records are joined. For example, the following query produces a 
list of authors accompanied by the ISBN numbers for books written by each author: 

SELECT FirstName, LastName, ISBN 

FROM Authors 

INNER JOIN AuthorISBN 

ON Authors.AuthorlD = AuthorISBN.AuthorlD 
ORDER BY LastName, FirstName 

The query merges the FirstName and LastName fields from table Authors with the 
ISBN field from table AuthorISBN, sorting the results in ascending orderby LastName 
and FirstName. Notice the use of the syntax tableName .fieldName in the ON part of the 
INNER JOIN. This syntax (called a fully qualified name ) specifies the fields from each ta- 
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ble that should be compared to join the tables. The “ tableName . ” syntax is required if the 
fields have the same name in both tables. The same syntax can be used in any query to dis- 
tinguish among fields in different tables that have the same name. Fully qualified names 
that start with the database name can be used to perform cross-database queries. 



Ifan SQL statement includes fields from multiple tables that have the same name, the state- 
ment must precede those field names with their table names and the dot operator (e.g., 

Au thors. Au thorlD). 



Common Programming Error 17.5 


In a query, failure to provide fully qualified names for fields that have the same name in two 
or more tables is an error. 


As always, the query can contain an ORDER BY clause. Figure 17.21 depicts the results 
of the preceding query, ordered by LastName and FirstName. [Note: To save space, 
we split the results of the query into two columns, each containing the FirstName, 
LastName and ISBN fields.] 







FirstName 

LastName 

ISBN 

FirstName 

LastName 

ISBN 

Harvey 

Deitel 

0130895601 

Harvey 

Deitel 

0130829293 

Harvey 

Deitel 

0130284181 

Harvey 

Deitel 

0134569555 

Harvey 

Deitel 

0130284173 

Harvey 

Deitel 

0130829277 

Harvey 

Deitel 

0130852473 

Paul 

Deitel 

0130125075 

Harvey 

Deitel 

0138993947 

Paul 

Deitel 

0130856118 

Harvey 

Deitel 

0130856118 

Paul 

Deitel 

0130161438 

Harvey 

Deitel 

0130161438 

Paul 

Deitel 

013028419x 

Harvey 

Deitel 

013028419x 

Paul 

Deitel 

0139163050 

Harvey 

Deitel 

0139163050 

Paul 

Deitel 

0130895601 

Harvey 

Deitel 

0135289106 

Paul 

Deitel 

0135289106 

Harvey 

Deitel 

0130895717 

Paul 

Deitel 

0130895717 

Harvey 

Deitel 

0132261197 

Paul 

Deitel 

0132261197 

Harvey 

Deitel 

0130895725 

Paul 

Deitel 

0130895725 

Harvey 

Deitel 

0130125075 

Tem 

Nieto 

0130284181 

Paul 

Deitel 

0130284181 

Tem 

Nieto 

0130284173 

Paul 

Deitel 

0130284173 

Tem 

Nieto 

0130829293 

Paul 

Deitel 

0130829293 

Tem 

Nieto 

0134569555 

Paul 

Deitel 

0134569555 

Tem 

Nieto 

0130856118 

Paul 

Deitel 

0130829277 

Tem 

Nieto 

0130161438 

Paul 

Deitel 

0130852473 

Tem 

Nieto 

013028419x 

Paul 

Deitel 

0138993947 






Fig. 17.21 Authotsfrom table Authors and ISBN numbeisof the authors 1 books, 
sorted in ascending orderby LastName and FirstName. 
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17.4.5Joining Data fromlablesAuthors, AuthorISBN, Tities 
and Publishers 

The Books database contains one predefined query (TitleAuthor), which selects as its 
results the title, ISBN number, author’s first name, author’s last name, Copyright year and 
publisher’s name for each book in the database. For books that have multiple authors, the 
query produces a separate composite record for each author. The TitleAuthor query is 
depicted in Fig. 17.22. Figure 17.23 contains a portion of the query results. 


1 SELECT Tities.Title, Tities.ISBN, Authors.FirstName, 
Authors.LastName, Tities.Copyright, 

3 Publishers.PublisherName 

4 FROM 

5 ( Publishers INNER JOIN Tities 

ON Publishers.PublisherlD = Tities.PublisherlD ) 

7 INNER JOIN 

8 ( Authors INNER JOIN AuthorISBN 

ON Authors.AuthorlD = AuthorISBN.AuthorlD ) 

10 ON Tities.ISBN = AuthorISBN.ISBN 

11 ORDER BY Tities.Title 


Fig. 17.22 TitleAuthor query of Books database. 







Title 

ISBN 

First¬ 

Name 

Last¬ 

Name 

Copy¬ 

right 

Publisher¬ 

Name 

Advanced Java 2 Platform 
How to Program 

0130895601 

Paul 

Deitel 

2002 

Prentice Hali 

Advanced Java 2 Platform 
How to Program 

0130895601 

Harvey 

Deitel 

2002 

Prentice Hali 

Advanced Java 2 Platform 
How to Program 

0130895601 

Sean 

Santry 

2002 

Prentice Hali 

C How to Program 

0131180436 

Harvey 

Deitel 

1992 

Prentice Hali 

C How to Program 

0131180436 

Paul 

Deitel 

1992 

Prentice Hali 

C How to Program 

0132261197 

Harvey 

Deitel 

1994 

Prentice Hali 

C How to Program 

0132261197 

Paul 

Deitel 

1994 

Prentice Hali 

C How to Program 

0130895725 

Harvey 

Deitel 

2001 

Prentice Hali 

C How to Program 

0130895725 

Paul 

Deitel 

2001 

Prentice Hali 

C# How To Program 

0130622214 

Tem 

Nieto 

2002 

Prentice Hali 

C# How To Program 

0130622214 

Paul 

Deitel 

2002 

Prentice Hali 

C# How To Program 

0130622214 

Jeffrey 

Listfield 

2002 

Prentice Hali 

C# How To Program 

0130622214 

Cheryl 

Yaeger 

2002 

Prentice Hali 

C# How To Program 

0130622214 

Marina 

Zlatkina 

2002 

Prentice Hali 


Fig. 17.23 Portion of the resuit set produced by the query in Fig. 17.22. (Part 1 of 2.) 
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Title 

ISBN 

First¬ 

Name 

Last¬ 

Name 

Copy¬ 

right 

Publisher¬ 

Name 

C# How To Program 

0130622214 

Harvey 

Deitel 

2002 

Prentice Hali 

C++ How to Program 

0130895717 

Paul 

Deitel 

2001 

Prentice Hali 

C++ How to Program 

0130895717 

Harvey 

Deitel 

2001 

Prentice Hali 

C++ How to Program 

0131173340 

Paul 

Deitel 

1994 

Prentice Hali 

C++ How to Program 

0131173340 

Harvey 

Deitel 

1994 

Prentice Hali 

C++ How to Program 

0135289106 

Harvey 

Deitel 

1998 

Prentice Hali 

C++ How to Program 

0135289106 

Paul 

Deitel 

1998 

Prentice Hali 

e-Business and e-Commerce 
for Managers 

0130323640 

Harvey 

Deitel 

2000 

Prentice Hali 

e-Business and e-Commerce 
for Managers 

0130323640 

Kate 

Stein- 

buhler 

2000 

Prentice Hali 

e-Business and e-Commerce 
for Managers 

0130323640 

Paul 

Deitel 

2000 

Prentice Hali 

e-Business and e-Commerce 
How to Program 

013028419X 

Harvey 

Deitel 

2001 

Prentice Hali 

e-Business and e-Commerce 
How to Program 

013028419X 

Paul 

Deitel 

2001 

Prentice Hali 

e-Business and e-Commerce 
How to Program 

013028419X 

Tem 

Nieto 

2001 

Prentice Hali 


Fig. 17.23 Portion of the resuit set produced by the query in Fig. 17.22. (Part2 of 2.) 


We added indentation to the query in Fig. 17.22 to make the query more readable. Let 
us now break down the query into its various parts. Lines 1-3 contain a comma-separated 
list of the fields that the query returns; the order of the fields from left to right specifies the 
fields’ order in the returned table. This query selects fields Title and ISBN from table 
Tities, fields FirstName and LastName from table Authors, field Copyright 
from table Tities and field PublisherName from table Publishers. For purposes 
of clarity, we fully qualified each field name with its table name (e.g., Tities . ISBN). 

Lines 5-10 specify the INNER JOIN operations used to combine information from the 
various tables. There are three INNER JOIN operations. It is important to note that, 
although an INNER JOIN is performed on two tables, either of those two tables can be the 
resuit of another query or another INNER JOIN. We use parentheses to nest the INNER 
JOIN operations; SQL evaluates the innermost set of parentheses first and then moves out- 
ward. We begin with the INNER JOIN: 

( Publishers INNER JOIN Tities 

ON Publishers.PublisherlD = Tities.PublisherlD ) 

which joins the Publishers table and the Tities table ON the condition that the Pub¬ 
lisherlD numbers in each table match. The resulting temporary table contains informa¬ 
tion about each book and its publisher. 
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The other nested set of parentheses contains the INNER JOIN: 

( Authors INNER JOIN AuthorISBN ON 

Authors.AuthorlD = AuthorISBN.AuthorlD ) 

which joins the Authors table and the AuthorISBN table ON the condition that the Au¬ 
thorlD fields in each table match. Remember that the AuthorISBN table has multiple en- 
tries for ISBN numbers of books that have more than one author. The third INNER JOIN: 


( Publishers INNER JOIN Tities 

ON Publishers.PublisherlD = Tities.PublisherlD ) 

INNER JOIN 

( Authors INNER JOIN AuthorISBN 

ON Authors.AuthorlD = AuthorISBN.AuthorlD ) 

ON Tities.ISBN = AuthorISBN.ISBN 


joins the two temporary tables produced by the two prior inner joins ON the condition that 
the Tities . ISBN field for each record in the first temporary table matches the corre- 
sponding AuthorISBN. ISBN field for each record in the second temporary table. The 
resuit of all these INNER JOIN operations is a temporary table from which the appropriate 
fields are selected to produce the results of the query. 

Finally, line 11 of the query: 


ORDER BY Tities.Title 

indicates that all the records should be sorted in ascending order (the default) by title. 


17.4.6 INSERT Sta te me nt 

The INSER Tstatement inserts a new record in a table. The simplest form for this statement is: 

INSERT INTO tableName ( fleldNamel, fielclName2, fieldNameN ) 

VALUES ( value 1, value2, valueN ) 

where tableName is the table in which to insert the record. The tableName is followed by 
a comma-separated list of field names in parentheses. The list of field names is followed by 
the SQL keyword VALUES and a comma-separated list of values in parentheses. The spec- 
ified values in this list must match the field names listed after the table name in both order 
and type (for example, if fleldNamel is specified as the FirstName field, then valuel 
should be a string in single quotes representing the first name). The INSERT statement: 

INSERT INTO Authors ( FirstName, LastName ) 

VALUES ( 'Sue', 'Smith' ) 

inserts a record into the Authors table. The statement indicates that values will be inserted 
for the FirstName and LastName fields. The corresponding values to insert are 1 Sue 1 
and ' Smith 1 . [Note: The SQL statement does not specify an AuthorlD in this example, 
because AuthorlD is an autoincrementfield in table Authors. For every new record add- 
ed to this table, MySQL assigns a unique AuthorlD value that is the next value in the auto¬ 
increment sequence (i.e., 1, 2, 3, etc.). In this case, MySQL assigns AuthorlD number 8 to 
Sue Smith.] Figure 17.24 shows the Authors table after the INSERT INTO operation. 
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AuthorlD 

FirstName 

LastName 

1 

Harvey 

Deitel 

2 

Paul 

Deitel 

3 

Tem 

Nieto 

4 

Kate 

Steinbuhler 

5 

Sean 

Santry 

6 

Ted 

Lin 

7 

Praveen 

Sadhu 

8 

David 

McPhie 

9 

Cheryl 

Yaeger 

10 

Marina 

Zlatkina 

11 

Ben 

Wiedermann 

12 

Jonathan 

Liperi 

13 

Jeffrey 

Listfield 

14 

Sue 

Smith 






Fig. 17.24 Authors afteran INSERT operation to add a record. 

Common Programming Error 17.6 

SQL statements use the single-quote (') character as a delimiter for strings. To specify a 
string containing a single quote (such as 0’Malley) in an SQL statement, the string must in¬ 
clude two single quotes in the position where the single-quote character should appear in the 
string (e.g., ' 0 1 ' Malley 1 ). Thefirst ofthe two single-quote characters acts as an escape 
character for the second. Failure to escape single-quote characters in a string that is part of 
an SQL statement is an SQL syntax error. 



17.4.7 UPDATE Statement 

An UPDATE statement modifies data in a table. The simplest form for an UPDATE state¬ 
ment is: 

UPDATE tableName 

SET fieldNamel = valuel, fleldName2 = value2, fieldNameN = valueN 
WHERE criteria 

where tableName is the table in which to update a record (or records). The tableName is 
followed by key word SET and a comma-separated list of field name/value pairs written in 
the format .fieldName = value. The WHERE clause specifies the criteria used to determine 
which record(s) to update. For example, the UPDATE statement: 

UPDATE Authors 

SET LastName = 'Jones' 

WHERE LastName = 'Smith' AND FirstName = 'Sue' 

updates a record in the Authors table. The statement indicates that LastName will be 
assigned the new value Jones for the record in which LastName currently is equal to 
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Smith and FirstName is equal to Sue. If we know the AuthorlD in advance of the 
UPDATE operation (possibly because we searched for the record previously), the WHERE 
clause could be simplified as follows: 

WHERE AuthorlD = 14 


Figure 17.25 depicts the Authors table after we perform the UPDATE operation. 

__ _,Common Programming Error 17.7 

Failure to use a WHERE clause with an UPDATE statement could lead to logic errors. 





17.4.8 DELETE Statement 

An SQL DELETE statement removes data from a table. The simplest form for a DELETE 
statement is: 

DELETE FROM tableName WHERE criteria 

where tableName is the table from which to delete a record (or records). The WHERE clause 
specifies the criteria used to determine which record(s) to delete. For example, the DELETE 
statement: 

DELETE FROM Authors 

WHERE LastName = 'Jones' AND FirstName = 'Sue' 

deletes the record for Sue Jones from the Authors table. Figure 17.26 depicts the Au¬ 
thors table after we perform the DELETE operation. 


AuthorlD 

FirstName 

LastName 

1 

Harvey 

Deitel 

2 

Paul 

Deitel 

3 

Tem 

Nieto 

4 

Kate 

Steinbuhler 

5 

Sean 

Santry 

6 

Ted 

Lin 

7 

Praveen 

Sadhu 

8 

David 

McPhie 

9 

Cheryl 

Yaeger 

10 

Marina 

Zlatkina 

11 

Ben 

Wiedermann 

12 

Jonathan 

Liperi 

13 

Jeffrey 

Listfield 

14 

Sue 

Jones 







Fig. 17.25 Table Authors afteran UPDATE operation to change a record. 
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AuthorlD 

FirstName 

LastName 

1 

Harvey 

Deitel 

2 

Paul 

Deitel 

3 

Tem 

Nieto 

4 

Kate 

Steinbuhler 

5 

Sean 

Santry 

6 

Ted 

Lin 

7 

Praveen 

Sadhu 

8 

David 

McPhie 

9 

Cheryl 

Yaeger 

10 

Maiina 

Zlatkina 

11 

Ben 

Wiedermann 

12 

Jonathan 

Liperi 

13 

Jeffrey 

Listfield 







Fig. 17.26 Table Authors aftera DELETE operation to remove a necond. 

Common Programming Error 17.8 

WHERE clauses can match multiple records. When deleting records from a database, be sure 
Io define a WHERE clause that matches only the records to be deleted. 



17.5 Python DB-API Specificatiori 

The code examples in this chapter use the MySQL database system; however, Python sup- 
ports many databases in addition to MySQL. Modules have been written that can interface 
with most popular databases, thus hiding database details from the programmer. These 
modules follow the Python Database Application Programming Interface (DB-API), a doc- 
ument that specifies common object and method names for manipulating any database. 

Specifically, the DB-API describes a Connection object that accesses the database 
(connects to the database). A program then uses the Connection object to create the 
Cursor object, which manipulates and retrieves data. We discuss the methods and attributes 
of these objects in the context of live-code examples throughout the remainder of the chapter. 

A Cursor enables a program to perform operations on a database (e.g., executing 
queries, inserting rows into a table, deleting rows from a table, etc.), as well as manipulate 
data returned from query execution. Three methods are available to fetch row(s) of a query 
resuit set —fetchone, fetchmany and fetchall. Method fetchone returns a 
tuple containing the next row in a resuit set stored in Cursor. Method fetchmany takes 
one argument—the number of rows to be fetched and returns the next set of rows of a resuit 
set as a tuple of tuples. Method fetchall returns ali rows of a resuit set as a tuple of 
tuples. On a large database, a fetchall would be impractical. 

A benefit of the DB-API is that a program does not need to know much about the data¬ 
base to which the program connects. Therefore, a program can use different databases with 
few modifications in the Python source code. For example, to switch from the MySQL 
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database to another database, a programmer needs to change three or four lines of code. 
However, the switch between databases may require modifications to the SQL code (to 
compensate for case sensitivity, etc.). 

17.6 Database Query Example 

Figure 17.27 presents a CGI program that performs a simple query on the Books database. 
The query retrieves all information about the authors in the Authors table and displays 
the data in an XHTML table. The program demonstrates connecting to the database, que- 
rying the database and displaying the results. The discussion that follows presents the key 
DB-API aspects of the program. [Note: The CGI script in this example is defined for use 
with the Apache Web server running on Microsoft Windows. On the CD that accompanies 
this book, we provide a version of this example for use with Apache running on Linux.] 




1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 


#!c:\python\python.exe 

# Fig. 17.27: figl7_27.py 

# Displays contents of the Authors table, 

# ordered by a specified field. 


import MySQLdb 
import egi 
import sys 


def printHeader( title ): 
print """Content-type: 


% title 

# obtain user query specifications 

form = egi.FieldStorage() 

# get "sortBy" value 

if form.has_key( 
sortBy = form[ 

else : 

sortBy = 

# get "sortOrder" value 

if form.has_key( ): 

sortOrder = form[ ].value 

else : 

sortOrder = 


) : 

].value 








Fig. 17.27 Connecting to and querying a database and displaying the results. 
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38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 
81 
82 

83 

84 

85 

86 

87 

88 
89 


printHeader( ) 

# connect to database and retrieve a cursor 
try : 

connection = MySQLdb.connect( db = ) 

# error connecting to database 

except MySQLdb.OperationalError, error: 
print , error 

sys.exit( ) 

# retrieve cursor 
else : 

cursor = connection.cursor() 

# query all records from Authors table 

cursor.execute( 

( sortBy, sortOrder ) ) 

allFields = cursor.description 
allRecords = cursor.fetchall() 

# close cursor and connection 

cursor.close() 
connection.close() 

# output results in a table 

print """\n<table border = "1" cellpadding = "3" 



# create table header 

for field in allFields: 

print % field [ ] 

print "</tr>" 

# display each record as a row 

for author in allRecords: 
print <tr>" 

for item in author: 

print % item 

print </tr>" 

print l, </table>" 

# obtain sorting method from user 
print 








Fig. 17.27 Connecting to and querying a database and displaying the results. 
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90 

# display sorting options 


91 

for field in allFields: 


92 

print .'cinput type = " 

radio" name = "sortBy" 

93 

% 

field[ 0 ] 

94 

print field[ ] 


95 

print " <br />" 


96 



97 

print """<br />\nSort Order 

xbr /> 

98 

<input type = "radio" 

name = "sortOrder" 

99 

value = "ASC" checked 

= "checked" /> 

100 

Ascending 


101 

<input type = "radio" 

name = "sortOrder" 

102 

value = "DESC" /> 


103 

Descending 


104 

<br /xbr />\n<input 

type = "submit" value 

105 

</form>\n\n</body>\n< 

/html>""" 











Fig. 17.27 Connecting to and querying a database and displaying the nesults. 
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Line 6 imports module MySQLdb , which contains classes and functions for manipu- 
lating MySQL databases in Python (available from sourceforge.net/projects/ 
mysql - python). For installation instructions, please visit www. deitel. com. 

Lines 86-105 create an XHTML form that enables the user to specify how to sort the 
records of the Authors table. Lines 24—36 retrieve and process this form. The records are 
sorted by the field assigned to variable sortBy. By default, the records are sorted by 
AuthorID. The user can select a radio button to sort the records by another field. Simi- 
larly, variable sortOrder has either the user-specified value or "ASC". 

Line 42 creates a Connection object called connection to manage the connec- 
tion between the program and the database. Function MySQLdb. connect receives the 
name of the database as the value of keyword argument db and creates the connection. 
1 Note: For operating systems other than Windows, MySQL may require a username and 
password to connect to the database. If so, pass the appropriate values as strings to keyword 
arguments user and passwd for function MySQLdb . connect.] If MySQLdb . con¬ 
nect fails, the function raises a MySQLdb OperationalError exception. 

Line 51 calls Connection method cursor to create a Cursor object for the data¬ 
base. The Cursor method execute takes as an argument an SQL command to execute 
against the database. Lines 54-55 query and retrieve all records from the Authors table 
sorted by the field specified in sortBy and ordered by the value of sortOrder. 

A Cursor object internally Stores the results of a database query. The Cursor attribute 
description contains a tuple of tuples in which each tuple provides information about a 
field in the resuit set obtained by method execute. The first value of each field’ s tuple is the 
field name. Line 57 assigns the tuple of field name records to variable allFields. Cursor 
method fetchall returns a tuple of tuples that contains all the internally stored results 
obtained by invoking method execute. Each subtuple in the returned tuple represents one 
record from the database, and each element in the record represents a field’ s value for that 
record. Line 58 assigns the tuple of matching records to variable allRecords. 

Cursor method close (line 61) closes the Cursor object; line 62 closes the Con¬ 
nection object with Connection method close. These methods explicitly close the 
Cursor and the Connection objects. Although the objects’ close methods execute 
when the objects are destroyed at program termination, programmers should explicitly 
close the objects once they are no longer needed. 



Good Programming Practice 17.2 

Explicitly close Cursor and Connection objects with their respective close methods 
as soon as the program no longer needs those objects. 


The remainder of the program displays the results of the database query in an XHTML 
table. Lines 65-83 display the Authors table’s ftelds using a for loop. For each field, the 
program displays the first entry in that field’s tuple (lines 69-70). Lines 75-83 display a table 
row for each record in the Authors table using nested for loops. The outer for loop (line 
75) iterates through each record in the table to create a new row. The inner for loop (line 78) 
iterates over each field in the current record and displays each field in a new cell. 


17.7 Querying the Books Database 

Figure 17.28 enhances the example of Fig. 17.27 by allowing the user to enter any query 
into a GUI program. This example introduces database error handling and the Pmw compo- 
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nents ScrolledFrame and PanedWidget. Module Pmw is introduced in Chapter 11, 
Graphical User Interface Components: Part 2. The GUI constructor (lines 13-39) creates 
four GUI elements. 

The program display contains two sections. The top section provides a Scrolled- 
Text component (lines 24—25) for entering a query string. The attribute text_height 
sets the scrolled text area as eight lines high. A Button component (lines 28-30) calls the 
method that executes the query string on the database. 

The bottom section contains a ScrolledFrame component (lines 33-35) for dis- 
playing the results of the query. A ScrolledFrame component is a scrollable area. The 
horizontal and vertical scroll bars are displayed because attributes hscrollmode and 
vscrollmode are assigned the value " static". The ScrolledFrame contains a 
PanedWidget component (lines 37-39) for dividing the resuit records into fields. 
Frame method interior specifies that the PanedWidget is created within the 
ScrolledFrame. A PanedWidget is a subdivided frame that allows the user to 
change the size of the subdivisions. The PanedWidget constructor’ s orient argument 
takes the value "horizontal " or "vertical If the value is "horizontal", the 
panes are placed left to right in the frame; if the value is "vertical", the panes are 
placed top to bottom in the frame. 


-& 


1 # Fig. 17.28: figl7_28.py 

2 # Displays results returned by a 

3 # query on Books database. 

4 

5 import MySQLdb 

6 from Tkinter import * 

7 from tkMessageBox import * 

8 import Pmw 

9 

10 class QueryWindow( Frame ): 

11 .'GUI Database Query Frame'"' 

12 

13 def _ init_( self ) : 

14 

15 

16 Frame._init_( self ) 

17 Pmw.initialise() 

18 self.pack( expand = 

19 self.master.title( \ 

20 

21 self.master.geometry( 

22 

23 # scrolled text pane for query string 

24 self.query = Pmw.ScrolledText( self, text_height = 

25 self.query.pack( fili = ) 

26 

27 # button to submit query 

28 self.submit = Button( self, text = , 

29 command = self.submitQuery ) 

30 self.submit.pack( fili = ) 


, fili 



) 






Fig. 17.28 GUI application forsubmitting queriesto a database. (Part 1 of 3.) 
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# frame to display query results 

self.frame = Pmw.ScrolledFrame( self, 

hscrollmode = , vscrollmode = ) 

self.frame.pack( expand = , fili = ) 

self.panes = Pmw.PanedWidget( self.frame.interior(), 
orient = ) 

self.panes.pack( expand = , fili = ) 

def submitQuery( self ) : 


# open connection, retrieve cursor and execute query 
try : 

connection = MySQLdb.connect( db = ) 

cursor = connection.cursor() 
cursor.execute( self.query.get() ) 
except MySQLdb.OperationalError, message: 
errorMessage = % \ 

( message[ ], message[ ] ) 

showerror( , errorMessage ) 

return 

else: # obtain user-requested information 

data = cursor.fetchall() 
fields = cursor.description 
cursor.close() 
connection.close() 


# ciear results of last query 

self.panes.destroy() 

self.panes = Pmw.PanedWidget( self.frame.interior(), 
orient = ) 

self.panes.pack( expand = , fili = ) 


# create pane and label for each field 

for item in fields: 

self.panes.add( item[ ] ) 

label = Label( self.panes.pane( item[ ] ), 

text = item[ ], relief = ) 

label.pack( fili = ) 


# enter results into panes, using labeis 

for entry in data: 


for i in range( len( entry ) ): 

label = Label( self.panes.pane( fields[ i ][ ] ), 

text = str( entry [ i ] ), anchor = , 

relief = , bg = ) 

label.pack( fili = ) 


self.panes.setnaturalsize() 








Fig. 17.28 GUI application forsubmitting queriesto a database. (Part2 of 3.) 
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84 def main(): 

85 QueryWindow().mainloop() 

86 

87 if _ name_ == : 

88 main() 



Fig. 17.28 GUI application forsubmitting queriesto a database. (Part 3 of 3.) 

When the user presses the Submit query button, method submitQuery (lines 41- 
82) performs the query and displays the results. Lines 45-58 contain a try/except/else 
statement that connects to and queries the database. The try statement creates a Connec- 
tion and a Cursor object and uses Cursor method execute to perform the user- 
entered query. Function MySQLdb . connect (line 46) fails if the specified database does 
not exist. Cursor method execute (line 48) fails if the query string contains an SQL 
syntax error. Each method raises an OperationalError exception. Lines 49-53 
handle this exception and call tkMessageBox function showerror with an appropriate 
error message. 

If the user-entered query string successfully executes, the program retrieves the resuit 
of the query. The else clause (lines 54-58) assigns the queried records to variable data 
and assigns metadata to variable fields. Metadata is data that describes data. For 
example, the metadata for a resuit set may include the field names and field types. The 
metadata 








fields = cursor.description 
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contains descriptive information about the resuit set of the user-entered query (line 56). 
Cursor attribute description contains a tuple of tuples that provides information 
about the fields obtained by method execute. 

PanedWidget method destroy (line 61) removes the existing panes to display the 
query data in new panes (lines 62-64). Lines 67-71 iterate over the field information to dis¬ 
play the names of the columns. For each field, method add adds a pane to the Paned¬ 
Widget. This method takes a string that identifies the pane. The Label constructor adds 
a label to the pane that contains the name of the field with the relief attribute set to 
RAISED. PanedWidget method pane (line 69) identifies the parent of this new label. 
This method takes the name of a pane and returns a reference to that pane. 

Lines 74-80 iterate over each record to create a label that contains the value of each 
field in the record. Method pane specifies the appropriate parent frame for each label. The 
expression 

self.panes.pane( fields [ i ] [ ] ) 

evaluates to the pane whose name is the field name for the / th value in the record. Once the 
results have been added to the panes, the PanedWidget method setnaturalsize 
sets the size of each pane to be large enough to view the largest label in the pane. 

17.8 Reading, Inserting and Updating a Database 

The next example (Fig. 17.29) manipulates a simple MySQL AddressBook database 
that contains one table (addresses) with 11 columns— ID (a unique integer ID number 
for each person in the address book), FirstName, LastName, Address, City, 
StateOrProvince, PostalCode, Country, EmailAddress, HomePhone and 
FaxNumber. All fields, except ID, are strings. The program provides capabilities for in¬ 
serting new records, updating existing records and searching for records in the database. 
[Note: The CD that accompanies this book contains a program called DBSetup. py that 
creates an empty AddressBook database.] 

Class AddressBook uses Button and Entry components to retrieve and display 
address information. The constructor creates a list of fields for one address book entry 
(lines 32-34). Line 38 initializes dictionary data member entries to hold references to 
Entry components. A for loop (lines 44-60) then iterates over the length of this list to 
create an Entry component for each field (lines 47-48). The loop also adds a reference to 
the Entry component to data member entries. Lines 58-60 create a key name for each 
entry, based on that entry’s field name. 


1 # Fig. 17.29: figl7 29,py 

2 # Inserts into, updates and searches a database 

3 

4 import MySQLdb 

5 from Tkinter import * 

6 from tkMessageBox import * 

7 import Pmw 

8 

9 class AddressBook( Frame ): 

10 


Fig. 17.29 Inserting, finding a nd updating records. (Part 1 of 5.) 
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11 





12 

def init ( self ): 




13 





14 





15 

Frame. init ( self ) 




16 

Pmw.initialise() 




17 

self.pack( expand = , fili = ) 




18 

self.master.title( 



) 

19 





20 

# buttons to execute commands 




21 

self.buttons = Pmw.ButtonBox( self, padx = ) 



22 

self.buttons.grid( columnspan = ) 




23 

self.buttons.add( , command = self.findAddress 

) 

24 

self.buttons.add( , command = self.addAddress ) 


25 

self.buttons.add( , command = 

self.updateAddress ) 

26 

self.buttons.add( , command = self.clearContents ) 

27 

self.buttons.add( , command = self.help. 

width 

= ) 

28 

self.buttons.alignbuttons() 




29 





30 





31 

# list of fields in an address record 




32 

fields = [ , 

/ 



33 

II - 1 


/ 


34 

/ / 

! 


] 

35 





36 

# dictionary with Entry components for 

values, 

keyed 

by 

37 

# corresponding addresses table field 

names 



38 

self.entries = {} 




39 




40 

self.IDEntry = StringVarO 

address 

id text 

41 

self.IDEntry.set ( ) 




42 





43 

# create entries for each field 




44 

for i in range ( len( fields ) ): 




45 

label = Label ( self, text = fields [ 

i ] + 

) 


46 

label.grid( row = i + , column = 

) 



47 

entry = Entry ( self, name = fields [ 

i ].lower(), 


48 

font = ) 




49 

entry.grid ( row = i + , column = 

1 



50 

sticky = + + + , padx = ) 




51 





52 

# user cannot type in ID field 




53 

if fields [ i ] == : 




54 

entry.config ( state = DISABLED, 




55 

textvariable = self.IDEntry, 

bg = 

) 


56 





57 

# add entry field to dictionary 




58 

key = fields [ i ] .replace( , 

) 



59 

key = key.upperO 




60 

self.entries! key ] = entry 




61 





62 

def addAddress( self ): 




63 






Fig. 17.29 Inserting, finding a nd updating records. (Part 2 of 5.) 
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116 


if self.entries[ ].get() != and \ 

self.entries[ ].get() != : 

# create INSERT query command 

query = 


+ \ 

* % \ 

( self.entries[ 
self.entries[ 
self.entries[ 
self.entries[ 
self.entries[ 
self.entries[ 
self.entries[ 
self.entries[ 
self.entries[ 
self.entries[ 
query = query[ : ] + 

# open connection, retrieve cursor and execute 
try : 

connection = MySQLdb.connect( db = 
cursor = connection.cursor() 
cursor.execute( query ) 
except MySQLdb.OperationalError, message: 
errorMessage = % \ 

( message[ ], message[ ] ) 

showerror( , errorMessage ) 

else : 

cursor.close() 
connection.close() 
self.clearContents() 

else : 

showwarning( , ) 

def findAddress( self ) : 


if self.entries[ ].get() != "" : 

# create SELECT query 

query = + \ 

+ \ 

self.entries [ ].get() + 

# open connection, retrieve cursor and execute query 
try : 

connection = MySQLdb.connect( db = ) 


query 


].get(), 

].get(), 

] .get () , 

] .get (), 

].get(), 
].get(), 

] .get () , 

].get(), 

]-get(), 

]-get() ) 






Fig. 17.29 Inserting, finding a nd updating records. (Part 3 of 5.) 
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139 
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152 

153 

154 

155 

156 

157 

158 

159 

160 
161 
162 

163 

164 

165 

166 

167 

168 


cursor = connection.cursor() 
cursor.execute( query ) 
except MySQLdb.OperationalError, message: 
errorMessage = % \ 

( message[ ], message[ ] ) 

showerror( , errorMessage ) 

self.clearContents() 
else: # process results 

results = cursor.fetchall() 
fields = cursor.description 


if not results: 

showinfo( , ) 

else : 


self.clearContents() 

# display results 

for i in range( len( fields ) ): 

if fields [ i ] [ ] == : 

self.IDEntry.set( str( results[ ] [ i ] ) ) 

else : 

self.entries[ fields[ i ][ 

INSERT, str( results[ 

cursor.close() 
connection.close() 

else: # user did not enter last name 

showwarning( , 

def updateAddress( self ) : 


] ].insert( 
] [ i ] ) ) 


if self.entries [ ].get(): 

# create UPDATE query command 

entryltems= self.entries.items() 
query = 

for key, value in entryltems: 
if key != : 

query += % ( key, value.get() ) 

query = query[ : ] + + self.IDEntry.get() 

# open connection, retrieve cursor and execute query 
try : 

connection = MySQLdb.connect( db = ) 

cursor = connection.cursor() 
cursor.execute( query ) 






Fig. 17.29 Inserting, finding and updating records. (Part4of 5.) 
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except MySQLdb.OperationalError, message: 
errorMessage = % \ 

( message[ ], message[ ] ) 

showerror( , errorMessage ) 

self.clearContents() 
else : 

showinfo( , 

cursor.close() 
connection.close() 

else: # user has not specified ID 

showwarning( , 


def clearContents( self ): 

for entry in self.entries.values(): 
entry.delete( , ) 

self.IDEntry.set( ) 

def help( self ): 

showinfo( , 


def main(): 

AddressBook () .mainloopO 


204 if _ name 

205 main() 


) 


) 








Fig. 17.29 Inserting, finding a nd updating records. (Part 5 of 5.) 
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Method addRecord (lines 62-102) adds anew record to the AddressBook database 
in response to the Add button in the GUI. The method first ensures that the user has entered 
values for the first and last name fields (lines 65-66). If the user enters values for these fields, 
the query string inserts arecord into the database (lines 69-85). Otherwise, tkMessageBox 
function showwarning reminds the user to enter the information (lines 101-102). Line 74 
includes ten string escape sequences whose values are replaced by the values contained in 
lines 75-84. Line 85 closes the values parentheses in the SQL statement. 

Lines 88-99 contain a try/except/else statement that connects to and updates the 
database (i.e., inserts the new record in the database). Line 99 invokes method clear- 
Contents (lines 185-191) to ciear the contents of the GUI. If an error occurs, tkMes¬ 
sageBox function showerror displays the error. 

Method findAddress (lines 104—146) queries the AddressBook database for a 
specific record when the user clicks the Find button in the GUI. Line 107 tests whether the 
last name text field contains data. If the entry is empty, the program displays an error. If the 
user has entered data in the last name text field, a SELECT SQL statement searches the data¬ 
base for the user-specified last name. We used asterisk (*) in the SELECT statement because 
line 126 uses metadata to get field names. Lines 115-143 contain a try/except/else 
statement that connects to and queries the database. If these operations succeed, the program 
retrieves the results from the database (lines 125-126). A message informs the user if the 
query does not yield results (lines 128-129). If the query does yield results, lines 134—140 dis- 
play the results in the GUI. Each field value is inserted in the appropriate Entry component. 
The record’ s ID must be converted to a string before it can be displayed. 

Method updateAddress (lines 148-183) updates an existing database record. The 
program displays a message if the user attempts to perform an update operation on a non- 
existent record. Line 151 tests whether the id for the current record is valid. Lines 155— 
162 create the SQL UPDATE statement. Lines 165-177 connect to and update the database. 

Method clearContents (lines 185-191) clears the text fields when the user clicks 
the Ciear button in the GUI. Method help (lines 193-199) calls a tkMessageBoxfunc- 
tion to display instructions about how to use the program. 


17.9 Internet and VNibrld Wide Web Resources 

This section presents several Internet and World Wide Web resources related to database 
programming. 

www.mysql.com 

This site offers the free MySQL database for download, the most current documentation and infor¬ 
mation about open-source licensing. 

ww3.one.net/~jhoffman/sqltut.html 

The Introduction to SQL has a tutorial, links to sites with more information about the language and 
examples. 

www.python.org/topics/databases 

This python. org page has links to modules like MySQLdb, documentation, a list of useful books 
about database programming and the DB-API specification. 

www.chordate.com/gadfly.html 

Gadfly is a free relational database written completely in Python. From this horne page, visitors can 
download the database and view its documentation. 
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SUMMARY 

• A database is an integrated collection of data. 

• A database management system (DBMS) provides mechanisms for storing and organizing data in 
a manner consistent with the database’s format. Database management systems allow for the ac- 
cess and storage of data without worrying about the intemal representation of databases. 

• Today’s most popular database systems are relational databases. 

• A language called Structured Query Language (SQL—pronounced as its individual letters or as 
“sequel”) is used almost universally with relational database systems to perform queries (i.e., to 
request information that satisfies given criteria) and to manipulate data. 

• Python programmers communicate with databases using modules that conform to the Python Da¬ 
tabase Application Programming Interface (DB-API). 

• The relational database model is a logical representation of data that allows the relationships be- 
tween the data to be considered independent of the actual physical structure of the data. 

• A relational database is composed of tables. Any particular row of the table is called a record (or 
row). 

• A primary key is a field (or fields) in a table that contain(s) unique data, which cannot be duplicat- 
ed in other records. This guarantees each record can be identified by a unique value. 

• A foreign key is a field in a table for which every entry has a unique value in another table and 
where the field in the other table is the primary key for that table. The foreign key helps maintain 
the Rule of Referential Integrity—every value in a foreign-key field must appear in another table’ s 
primary-key field. Foreign keys enable information from multiple tables to be joined together and 
presented to the user. 

• Each colurnn of the table represents a different field (or column or attribute). Records normally are 
unique (by primary key) within a table, but particular field values may be duplicated between 
records. 

• SQL enables programmers to define complex queries that select data from a table by providing a 
complete set of commands. 

• The results of a query commonly are called resuit sets (or record sets). 

• A typical SQL query selects information from one or more tables in a database. Such selections 
are performed by SELECT queries. The simplest format of a SELECT query is 

SELECT * FROM tableName 

• An asterisk (*) indicates that ali rows and columns from table tableName of the database should 
be selected. 

• To select specific fields from a table, replace the asterisk (*) with a comma-separated list of field 
names. 

• In most cases, it is necessary to locate records in a database that satisfy certain selection criteria. 
Only records that match the selection criteria are selected. SQL uses the optional WHERE clause in 
a SELECT query to specify the selection criteria for the query. The simplest format of a SELECT 
query with selection criteria is 

SELECT fieldNamel FROM tableName WHERE criteria 

• The WHERE clause condition can contain operators <, >, < = , >=. =, <> and LIKE. 

• Operator LIKE is used for pattern matching with wildcard characters percent ( % ) and underscore 
( _ ). Pattern matching allows SQL to search for similar strings that “match a pattern.” 
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• A pattem that contains a percent character (%) searches for strings that have zero or more charae - 
ters at the percent character’s position in the pattem. 

• An underscore (_) in the pattern string indicates a single character at that position in the pattem. 

• The results of a query can be arranged in ascending or descending order using the optional ORDER 
BY clause. The simplest form of an ORDER BY clause is 

SELECT * FROM tableName ORDER BY fleld ASC 
SELECT * FROM tableName ORDER BY field DESC 

where ASC specifies ascending order (lowest to highest), DESC specifies descending order (high- 
est to lowest) and field specifies the field on which the sort is based. 

• Multiple fields can be used for ordering purposes with an ORDER BY clause of the form 

ORDER BY fieldl sortingOrder, field2 sortingOrder, ... 

where sortingOrder is either ASC or DESC. Note that the sortingOrder does not have to be iden- 
tical for each field. 

• The WHERE and ORDER BY clauses can be combined in one query. 

• A join merges records from two or more tables by testing for matching values in a field that is com- 
mon to both tables. The simplest format of a join is 

SELECT fieldNamel, JieldName2, ... 

FROM tablel 
INNER JOIN table2 

ON tablel .fieldName = table2 .fieldName 

• A fully qualified name specifies the fields from each table that should be compared to join the ta¬ 
bles. The “tableName syntax is required if the fields have the same name in both tables. The 
same syntax can be used in a query to distinguish fields in different tables that happen to have the 
same name. Fully qualified names that start with the database name can be used to perform cross- 
database queries. 

• The INSERT statement inserts a new record in a table. The simplest form of this statement is 

INSERT INTO tableName ( fieldNamel, ..., fieldNameN ) 

VALUES ( valuel,..., valueN ) 

where tableName is the table in which to insert the record. The tableName is followed by a com- 
ma-separated list of field names in parentheses. (This list is not required if the INSERT INTO op- 
eration specifies a value for every column of the table in the correct order.) The list of field names 
is followed by the SQL keyword VALUES and a comma-separated list of values in parentheses. 
The values specified here should match the field names specified after the table name in order and 
type (i.e., if fieldNamel is supposed to be the FirstName field, then valuel should be a string in 
single quotes representing the first name). 

• An UPDATE statement modifies data in a table. The simplest form for an UPDATE statement is 

UPDATE tableName 

SET fieldNamel = valuel, ..., fieldNameN = valueN 
WHERE criteria 

where tableName is the table in which to update a record (or records). The tableName is followed by 
keyword SET and a comma-separated list of field name/value pairs in the format fieldName = value. 
The WHERE clause specifies the criteria used to determine which record(s) to update. 
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• An SQL DELETE statement removes data from a table. The simplest form for a DELETE state- 
ment is 

DELETE FROM tableName WHERE criteria 

where tableName is the table from which to delete a record (or records). The WHERE clause spec- 
ifies the criteria used to determine which record(s) to delete. 

• Modules have been written that can interface with most popular databases, hiding database details 
from the programmer. These modules follow the Python Database Application Programming In¬ 
terface (DB-API), a document that specifies common object and method names for manipulating 
any database. 

• The DB-API describes a Connection object that programs create to connect to a database. 

• A program can use a Connection object to create a Cursor object, which the program uses to 
execute queries against the database. 

• The major benefit of the DB-API is that a program does not need to know much about the database 
to which the program connects. Therefore, the programmer can change the database a program 
uses without changing vast amounts of Python code. However, changing the DB often requires 
changes in the SQL code. 

• Module MySQLdb contains classes and functions for manipulating MySQL databases in Python. 

• Function MySQLdb. connect creates the connection. The function receives the name of the da¬ 
tabase as the value of keyword argument db. If MySQLdb. connect fails, the function raises an 
OperationalError exception. 

• The Cursor method execute takes as an argument a query string to execute against the data¬ 
base. 

• A Cursor object internally Stores the results of a database query. 

• The Cursor method f etchall retums a tuple of records that matched the query. Each record 
is represented as a tuple that contains the values of that records freld. 

• The Cursor method close closes the Cursor object. 

• The Connection method close closes the Connection object. 

• A PanedWidget is a subdivided frame that allows the user to change the size of the subdivi- 
sions. The PanedWidget constructor’s orient argument takes the value "horizontal " or 
"vertical". If the value is "horizontal", the panes are placed left to right in the frame; if 
the value is “vertical ", the panes are placed top to bottom in the frame. 

• Metadata are data that describe other data. The Cursor attribute description contains a tuple 
of tuples that provides information about the fields of the data obtained by function execute. The 
cursor and connection are closed. 

• The PanedWidget method pane takes the name of a pane and retums a reference to that pane. 

• The PanedWidget method setnaturalsize sets the size of each pane to be large enough to 
view the largest label in the pane. 


TERMINOLOGY 

AND keyword 
ASC keyword 
asterisk (*) 
close method 
column 



Connection object 
Cursor object 
data attribute 
database 

database management system (DBMS) 
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database table 
DELETE statement 
DESC keyword 
escape character 

execute method 
fetchall method 
field 

foreign key 
FROM keyword 
fully qualified name 
INSERT statement 
INTO keyword 
interior method 
joining tables 
LIKE keyword 
MySQL 

MySQLdb module 
open source 
ORDER BY keyword 
PanedWidget 

pattern matching 

percent (%) SQL wildcard character 
primary key 


Python Database Application Programming 
Interface (DB-API) 
query 
record 
record set 
relational database 
resuit set 
row 

Rule of Referential Integrity 
scalability 

ScrolledFrame component 
SELECT statement 
selection criteria 
SET keyword 
shell 

Structured Query Language (SQL) 
table 

underscore (_) wildcard character 

UPDATE statement 

VALUES keyword 

WHERE clause 

percent 


SELF-REVIEW EXERCISES 

17.1 Fili in the blanks in each of the following statements: 

a) The most popular database query language is_. 

b) A relational database is composed of_. 

c) A table in a database consists of_and_. 

d) The_uniquely identifies each record in a table. 

e) SQL provides a complete set of commands (including SELECT) that enable program- 

mers to define complex_. 

f) SQL keyword_is followed by the selection criteria that specify the records to 

select in a query. 

g) SQL keyword_specifies the order in which records are sorted in a query. 

h) A_specifies the fields from multiple tables table that should be compared to 

join the tables. 

i) A_is an integrated collection of data which is centrally controlled. 

j) A_is a field in a table for which every entry has a unique value in another 

table and where the field in the other table is the primary key for that table. 

17.2 State whether the following are true or false. If false, explain why. 

a) DELETE is not a valid SQL keyword. 

b) Tables in a database must have a primary key. 

c) Python programmers communicate with databases using modules that conform to the 
DB-API. 

d) UPDATE is a valid SQL keyword. 

e) The WHERE clause condition can not contain operator < >. 

f) Not ali database systems support the LIKE operator. 

g) The INSERT INTO statement inserts a new record in a table. 

h) MySQLdb. connec t is used to create a connection to database. 
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i) A Cursor object can execute queries in a database. 

j) Once created, a connection with database can not be closed. 

ANSWERS TO SELF-REVIEW EXERCISES 

17.1 a) SQL. b) tables. c) rows, columns. d) primary key. e) queries. f) WHERE. g) ORDER BY. 
h) fully qualified name. i) database. j) foreign key. 

17.2 a) False. DELETE is a valid SQL keyword—it is used to delete records. b) False. Tables in a 
database normally have primary keys. c) True. d) True. e) False. The WHERE clause can contain op¬ 
erator <> (not equals). f) True. g) True. h) True. i) True. j) False. Connection. close can close 
the connection. 

EXERCISES 

17.3 Write SQL queries for the Books database (discussed in Section 17.3) that perform each of 
the following tasks: 

a) Select ali authors from the Authors table. 

b) Select ali publishers from the Publishers table. 

c) Select a specific author and list ali books for that author. Include the title, Copyright year 
and ISBN number. Order the information alphabetically by title. 

d) Select a specific publisher and list ali books published by that publisher. Include the title, 
Copyright year and ISBN number. Order the information alphabetically by title. 

17.4 Write SQL queries for the Books database (discussed in Section 17.3) that perform each of 
the following tasks: 

a) Add a new author to the Authors table. 

b) Add a new title for an author (remember that the book must have an entry in the 
AuthorISBN table). Be sure to specify the publisher of the title. 

c) Add a new publisher. 

17.5 Modify Fig. 17.27 so that the user can read different tables in the books database. 

17.6 Create a MySQL database that contains information about students in a university. Possible 
fields might include date of birth, major, current grade point average, credits eamed, etc. Write a Py¬ 
thon program to manage the database. Include the following functionality: sort ali students according 
to GPA (descending), create a display of all students in one particular major and remove ali records 
from the database where the student has the required amount of credits to graduate. 

17.7 Modify the FIND capability in Fig. 17.29 to allow the user to scroll through the results of the 
query in case there is more than one person with the specified last name in the Address Book. Provide 
an appropriate GUI. 

17.8 Modify the solution from Exercise 17.7 so that the program checks whether a record already 
exists in the database before adding it. 





























Multithreading 


Objectives 

• To understand the notion of multithreading. 

• To appreciate how multithreading can improve 
performance. 

• To understand how to create, manage and destroy 
threads. 

• To understand the life cycle of a thread. 

• To study several examples of thread synchronization. 

• To understand daemon threads. 

The spider’s touch, how exquisitely fine! 

Feels at each thread, and lives along the line. 

Alexander Pope 

A person with one watch knows what time it is; a person with 
two watehes is never sure. 

Proverb 

Conversation is but carving! 

Give no more to every guest, 

Then he 's able to digest. 

Jonathan Swift 

Leam to labor and to wait. 

Henry Wadsworth Longfellow 

The most general definition of beauty.. .Multeity in Unity. 
Samuel Taylor Coleridge 



Under 

Constructi on 
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Outline 

19.1 Introduction 

19.2 threading Module 

19.3 Thread Scheduling 

19.4 Thread States: Life Cycle of a Thread 

19.5 Thread Synchronization 

19.6 Producer/Consumer Relationship Without Thread Synchronization 

19.7 Producer/Consumer Relationship With Thread Synchronization 

19.8 Producer/Consumer Relationship: The Circular Buffer 

19.9 Semaphores 

19.10 Events 

19.11 Daemon Threads 

Summary • Teiminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 


19.1 Introduction 

In Chapter 18, we discussed how to use processes to perform concurrent tasks in our pro- 
grams. In this chapter, we discuss multithreading techniques for performing similar tasks. 
A thread is often called a “light-weight” process, because the operating system generally 
requires less resources to create and manage threads. 

Python is different than many popular general-purpose programming languages in that 
it makes multithreading primitives available to the applications programmer. The pro- 
grammer specifies that applications contain threads of execution, each thread designating 
a portion of a program that may execute concurrently with other threads. This capability 
gives the Python programmer powerful capabilities not available in C, C++ or other single- 
threaded languages. 

Many tasks require a multithreaded programming approach. When a browser down- 
loads large files such as audio clips or video clips from the World Wide Web, we do not 
want to wait until an entire clip is downloaded before starting the playback. So we can put 
multiple threads to work: one that downloads a clip, and another that plays the clip so that 
these activities, or tasks, may proceed concurrently. To avoid choppy playback, we coordi- 
nate the threads so that the player thread does not begin until there is a sufficient amount of 
the clip in memory to keep the player thread busy. 

Performance Tip 19.1 

A problem with single-threaded applications is thatpossibiy lengthy activities must complete 
before other activities can begin. Users feel they already spend too much time waiting with 
Internet and World Wide Web applications, so multithreading is immediately appealing. 

Another example of multithreading is Python’s automatic garbage collection. C and 
C++ place the responsibility for reclaiming dynamically allocated memory with the pro¬ 
grammer. Python provides a garbage collector thread that automatically reclaims memory 
that is no longer needed. 
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Testing and Debugging Tip 19.1 


In C and C++, programmers must explicitly provide statements for reclaiming dynamically 
allocated memory. When memory is not reclaimed (because a programmer forgets to do so, 
or because ofa logic error or because an exception diverts program control), this results in 
an all-too-common error called a memory leak that can eventually exhaust the supply offree 
memory and may cause program termination. Python 's automatic garbage collection elimi- 
nates the vast majority of memory leaks, i.e., those that are due to orphaned (unreferenced) 
objects. 



Performance Tip 19.2 

Python ’s garbage collection is not as efficient as the dynamic memory management code the 
best C and C++ programmers write, but it is relatively efficient and much saferfor the pro¬ 
grammer. 



Performance Tip 19.3 

Setting an object reference to None marks that object for eventual garbage collection (if 
there are no other references to the object). This can help conserve memory in a systern in 
which a local object is not going out of scope because the method it is in executes for a 
lengthy period. 


Writing multithreaded programs can be tricky. Although the human mind can perform 
many functions concurrently, humans find it difficult to jump between parallel “trains of 
thought.” To see why multithreading can be difficult to program and understand, try the fol- 
lowing experiment: Open three books to page 1. Now try reading the books concurrently. 
Read a few words from the first book, then read a few words from the second book, then 
read a few words from the third book, then loop back and read the next few words from the 
first book, and so on. After a brief time you rapidly appreciate the challenges of multi¬ 
threading: switching between books, reading briefly, remembering your place in each 
book, moving the book you are reading closer so you can see it, pushing books you are not 
reading aside, and amidst all this chaos, trying to comprehend the content of the books! 


19.2 threading Module 

In this section we overview the various thread-related Python capabilities provided by mod¬ 
ule threading. Although Python is perhaps one of the most portable programming lan- 
guages, certain portions of the language are nevertheless platform dependent. The default 
installation of Python may not install the threading module on all systems. In this case, 
the threading module may need to be compiled by hand and Python re-installed. 

rtrU 

m Python multithreading is platform dependent. Thus, the threading module may have to be 
compiled by hand and reinstalled with Python. 

Programs create threads by instantiating objects of class threading. Thread. Usu- 
ally, we create a subclass of class Thread that extends the basic capabilities of the class 
to perform the tasks we want to perform. The code that “does the real work” of a thread is 
placed in its run method. The run method is overridden in a subclass of Thread. 
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A program launches a thread’s execution by calling the thread’s start method, 
which, in turn, calls the run method. After start launches the thread, start returns to 
its caller immediately. The caller then executes concurrently with the launched thread. If 
the thread has already been started, the start method raises an AssertionError 
exception. 

Method isAlive returns 1 if start has been called for a given thread and the thread 
is not dead (i.e., its controlling run method has not completed execution). Method set- 
Name sets a Thread’ s name. Method getName returns the name of the Thread. Using 
the print statement on a thread displays the thread’s name and current state. Function 
threading. current Thread returns a reference to the currently executing Thread. 
Function threading. enumerate returns a list of all currently executing Thread 
objects, including the main thread. Function threading. activeCount returns the 
length of the list returned by threading. enumerate. 

Thread method join waits for the thread whose join method is called to die before 
the caller can proceed. A thread may not call its own join method, only that of other 
threads. An optional argument accepted by join is a timeout, a floating-point number 
specifying the number of seconds that the caller waits. Passing no argument to method 
join indicates that the caller waits forever for the target thread to die before the caller pro- 
ceeds. Such waiting can be dangerous; it can lead to two particularly serious problems 
called decidlock , in which one or more threads will wait forever for an event that cannot 
occur, and indefinite postponement , in which one or more threads will be delayed for some 
unpredictably long time. We will discuss deadlock in more detail in Section 19.5. 


19.3 Thread Scheduling 

The Python interpreter Controls all threads in a program. When the interpreter starts, either 
in an interactive session or when invoked on a file, the “main” thread begins. This thread 
is the caller for all other threads. Only one thread is permitted to run by the interpreter at 
any one time. The interpreter keeps track of the global interpreter lock (GIL) that Controls 
which thread the interpreter is running. When a program contains more than one running 
thread, these threads are switched in and out of the interpreter through the GIL, at specified 
intervals. 

19.4 Thread States: Life Cycle of a Thread 

At any time, a thread is said to be in one of several thread States (Fig. 19.1). Let us say that 
a thread that was just created is in the born state. The thread remains in this state until the 
thread’s start method is called; this causes the thread to enter the ready state (also known 
as the runnable state). A ready thread enters the running state when the interpreter executes 
the thread (i.e. method run executes). A thread enters the dead state when its run method 
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completes or terminates for any reason—the interpreter eventually disposes of a dead 
thread. 



Fig. 19.1 Life cycle of a thread. 

One common way for a running thread to enter the blocked state is when the thread 
issues an input/output request. In this case, a blocked thread becomes ready when the I/O 
it is waiting for completes. The interpreter does not execute a blocked thread even if the 
interpreter is free. 

When a running thread calls function time. sleep, that thread enters the sleeping 
state. A sleeping thread becomes ready after the designated sleep time expires. A sleeping 
thread cannot use the interpreter. A thread enters the dead state when its run method either 
completes or raises an uncaught exception. 

The program in Fig. 19.2 demonstrates basic threading techniques, including creation 
of a class derived from threading. Thread, construction of a thread and using function 
time. sleep in a thread. Each thread of execution created in the program displays its 
name after sleeping for a random amount of time between 1 and 5 seconds. 


1 # Fig. 19.2: figl9_02.py 

2 # Show multiple threads printing at different intervals. 

3 

4 import threading 

5 import random 

6 import time 

7 

Fig. 19.2 Multiple threads printing at random intervals (part 1 of2). 
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o 

class PrintThread ( threading.Thread ): 



10 





n 

def init ( self, threadName ): 



12 





13 





14 

threading.Thread._init_ 

( self, 

name = threadName ) 

15 

self.sleepTime = random.randrange ( 

, ) 

16 

print "Name: %s; sleep: %( 

% \ 



17 

( self.getName () , self 

. sleepTime 

) 

18 





19 

# overridden Thread run method 



20 

def run ( self ): 




21 





22 





23 

print self.getName () , 




24 

time.sleep ( self.sleepTime ) 



25 

print self.getName () , 




26 





27 

threadl = PrintThread ( 

) 



28 

thread2 = PrintThread ( 

) 



29 

thread3 = PrintThread ( 

) 



30 

thread4 = PrintThread ( 

) 



31 





32 

print "\nStarting threads" 




33 





34 

threadl.start () 

method 

of 

threadl 

35 

thread2.start () 

method 

of 

thread2 

36 

thread3.start () 

method 

of 

thread3 

37 

thread4.start() 

method 

of 

thread4 

38 





39 

print "Threads started\n" 





Name: threadl; sleep: 5 
Name: thread2; sleep: 3 
Name: thread3; sleep: 4 
Name: thread4; sleep: 1 

Starting threads 
threadl going to sleep 
thread2 going to sleep 
thread3 going to sleep 
thread4 going to sleep 
Threads started 


thread4 done sleeping 
thread2 done sleeping 
thread3 done sleeping 
threadl done sleeping 


Fig. 19.2 Multiple threads printing at random intervals (part 2 of 2). 


Class PrintThread —which inherits from threading. Thread so each object 
of the class can execute in parallel—consists of attribute sleepTime, a constructor and a 

© Copyright 1992-2002 by Deitel & Associates, Inc. AII Rights Reserved. 8/21/01 






Chapter 19 


Multithreading 751 


run method. Attribute sleepTime Stores a random integer value determined when a 
PrintThread object is constructed. When started, each PrintThread object sleeps 
for the amount of time specified by sleepTime, and then outputs its name. 

The PrintThread constructor (lines 11-17) first calls the base class constructor, 
passing the class instance and the thread’s name. A thread’s name is specified with 
Thread keyword argument name. If no name is specified, the thread will be assigned a 
unique name in the form " Thread-/; " where n is an integer. The constructor then initial- 
izes sleepTime to a random integer between 1 and 5, inclusive. Then, the program out¬ 
puts the name of the thread and the value of sleepTime, to show the values for the 
particular PrintThread being constructed. 

When a PrintThread’s start method (inherited from Thread) is invoked, the 
PrintThread object enters the ready state. When the interpreter switches in the 
PrintThread object, it enters the running state and its run method begins execution. 
Method run (lines 20-25) prints a message indicating that the thread is going to sleep and 
then invokes function time . sleep (line 24) to immediately put the thread into a sleeping 
state. When the thread awakens after sleepTime seconds, it is placed into a ready state 
again until it is switched into the processor. When the PrintThread object enters the 
running state again, it outputs its name (indicating that the thread is done sleeping), its run 
method terminates and the thread object enters the dead state. 

The main portion of the program instantiates four PrintThread objects and invokes 
the Thread class start method on each one to place all four PrintThread objects in 
a ready state. After this, the main program’s thread terminates. However, the example con¬ 
tinues running until the last PrintThread dies (i.e., has completed its run method). 


19.5 Thread Synchronization 

Multithreaded programs often contain code wherein two or more threads attempt to access 
and/or modify the value of a shared piece of data. For example, two threads may be reading 
and updating the value of a variable simultaneously. If a multithreaded program does not 
protect access to the shared variable, the value of that variable may become corrupted. The 
sections of code that access shared data are often re lene d to as critical sections. To prevent 
multiple threads from changing data simultaneously, multithreaded programs typically re- 
strict how many threads can execute the code in a critical section at a time. This restriction 
is accomplished through various synchronization primitives. 

The threading module provides many thread synchronization primitives. The most 
primitive synchronization mechanism is the lock. A lock object (created with class 
threading. Lock) defines two methods— acquire and release. When a thread 
calls the acquire method, the lock enters its locked state. Once a lock has been acquired, 
no other threads may acquire the lock until the lock is released. This means that if another 
thread calls a lock’s acquire method, the thread will block indefinitely. When the orig- 
inal thread calls the lock’s release method, the lock enters the unlocked state and the 
blocked thread is notified (awakened). At this point, the previously blocked thread acquires 
the lock. If more than one thread is blocked on a lock, only one of those threads is notified. 

Locks can be used to restrict access to a critical section. The program is written such 
that the thread must acquire a lock before entering a critical section and release the lock 
when exiting the critical section. Thus, if one thread is executing the critical section, any 
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other thread that attempts to enter the critical section will block until the original thread has 
exited the critical section. 

Such a procedure provides only the most basic level of synchronization. Sometimes, 
however, we would like to create more sophisticated threads that access a critical section 
only when some event occurs (i.e., a data value has changed). This can be done by using 
condition variables. A thread uses a condition variable when the thread wants to monitor 
the state of some object or wants to be notified when some event occurs. When the object’s 
state changes or the event occurs, blocked threads are notified. We discuss condition vari¬ 
ables throughout this chapter in the context of the classic producer/consumer problem. The 
solution involves a consumer thread that accesses a critical section only when notified by 
a producer thread, and vice versa. 

Condition variables are created with class threading. Condition. Because con¬ 
dition variables contain an underlying lock, condition variables provide acquire and 
release methods. Additional condition variable methods are wait and notify. When 
a thread has acquired the underlying lock, calling method wait releases the lock and 
causes the thread to block until it is awakened by a call to notify on the same condition 
variable. Calling method notify wakes up one thread waiting on the condition variable. 
Ali waiting threads can be woken up by invoking the condition variable’s notifyAll 
method. 

Semaphores (created with class threading. Semaphore) are synchronization 
primitives that allow a set number of threads to access a critical section. The Semaphore 
object uses a counter to keep track of the number of threads that acquire and release the 
semaphore. When a thread calls method acquire, the thread blocks if the counter is 0. 
Otherwise, the thread acquires the semaphore and method acquire decrements the 
counter. Calling method release releases the semaphore, increments the counter and 
notifies a waiting thread. The initial value of the internal counter can be passed as an argu- 
ment to the Semaphore constructor (default is 1). Because the internal counter can never 
have a negative value, specifying a negative counter value raises an AssertionError 
exception. 

Sometimes, one or more threads want to wait for a particular event to occur before pro- 
ceeding with their execution. An Event object (created with class threading. Event) 
has an internal flag that is initially set to false (i.e., the event has not occurred). A thread 
that calls Event method wait blocks until the event occurs. When the event occurs, 
method set is called to set the flag to true and awaken all waiting threads. A thread that 
calls wait after the flag is true does not block at all. Method isSet returns true if the flag 
is true. Method ciear sets the flag to false. 

Writing a program that uses locks, condition variables or any other synchronization 
primitive takes careful scrutiny to ensure that the program does not deadlock. A program 
or thread deadlocks when the program or thread blocks forever on a needed resource. For 
example, consider the scenario where a thread enters a critical section that tries to open a 
file. If the file does not exists and the thread does not catch the exception, the thread termi- 
nates before releasing the lock. Now all other threads will deadlock, because they block 
indefinitely after they call the lock’s acquire method. 



-.Common Programming Error 19.1 


Threads in the waiting state for a lock object must eventually be awakened explicitly (i.e., by 
releasing the lock) or the thread will wait forever. This may cause deadlock. 
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ssting and Debugging Tip 19.2 


Be sure that every call to acquire has a corresponding call to release thatwill eventu- 
ally end the waiting. 



Performance Tip 19.4 

Synchronization to achieve correctness in multithreaded programs can make programs run 
slowerdue to lock overhead andfrequentlymoving threads between the running, waiting and 
ready States. There is not much to say, however, for highly efficient, incorrect multithreaded 
programs! 


19.6 Producer/Consumer Relationship Without Thread 
Synchronization 

In this section, we use a producer/consumer relationship to demonstrate the wait and no- 
tify methods of a condition variable. In a producer/consumer relationship, a producer 
thread calling a produce method may see that the consumer thread has not read the last 
message from a shared region of memory called a haffer, so the producer thread calls wait 
on a condition variable. When a consumer thread reads the message, it calls notify on 
the condition variable to allow a waiting producer to proceed. When a consumer thread 
calls a consume method and finds the buffer empty, it calls wait. A producer calling a pro¬ 
duce method and finding the buffer empty, writes to the buffer, then calls notify so a 
waiting consumer can proceed. 

Shared data can get corrupted if we do not synchronize access among multiple threads. 
Consider a producer/consumer relationship in which a producer thread deposits a sequence 
of numbers (we use 1, 2, 3, ...) into a slot of shared memory. The consumer thread reads 
this data from the shared memory and prints the data. Figure 19.3 demonstrates a producer 
(defined in Fig. 19.4) and a consumer (defined in Fig. 19.5) accessing a single shared cell 
of memory without any synchronization (defined in Fig. 19.6). The program prints what the 
producer produces as it produces it and what the consumer consumes as it consumes it. 


1 # Fig. 19.3: figl9_03.py 

2 # Show multiple threads modifying shared object. 

3 

4 from Unsynchronizedlnteger import Unsynchronizedlnteger 

5 from ProduceInteger import ProduceInteger 

6 from ConsumeInteger import ConsumeInteger 

7 

8 # initialize integer and threads 

9 number = Unsynchronizedlnteger() 

10 producer = Producelnteger( , number ) 

11 consumer = Consumelnteger( , number ) 

12 

13 print "Starting threads.. \r 

14 

15 # start threads 

16 producer.start() 

17 consumer.start() 

Fig. 19.3 Threads modifying unsynchronized shared object (part 1 of 2). 
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T8- 

19 # wait for threads to terminate 

20 producer.join() 

21 consumer.join() 

22 

23 print "\nAll threads have termi: 


Starting threads... 

Producer setting sharedNumber to 1 
Producer setting sharedNumber to 2 
Consumer retrieving sharedNumber value 2 
Consumer retrieving sharedNumber value 2 
Consumer retrieving sharedNumber value 2 
Producer setting sharedNumber to 3 
Consumer retrieving sharedNumber value 3 
Producer setting sharedNumber to 4 
Consumer retrieving sharedNumber value 4 
Consumer retrieving sharedNumber value 4 
Consumer retrieving sharedNumber value 4 
Producer setting sharedNumber to 5 
Consumer retrieving sharedNumber value 5 
Producer setting sharedNumber to 6 
Producer setting sharedNumber to 7 
Producer setting sharedNumber to 8 
Producer setting sharedNumber to 9 
Consumer retrieving sharedNumber value 9 
Consumer retrieving sharedNumber value 9 
Consumer retrieved values totaling: 44 
Terminating Consumer 
Producer setting sharedNumber to 10 
Producer finished producing values 
Terminating Producer 

All threads have terminated. 


Fig. 19.3 Threads modifying unsynchronized shared object (part 2 of 2). 

Because the threads are not synchronized, data can be lost if the producer places new 
data into the slot before the consumer consumes the previous data, and data can be “dou- 
bled” if the consumer consumes data again before the producer produces the next item. To 
show these possibilities, the consumer thread in this example sums all the values it reads. 
The producer thread produces values from 1 to 10. If the consumer is able to read each 
value produced once, the sum would be 55. However, if you execute this program several 
times, you will see that the total is rarely, if e ver, 55. 

Figure 19.3 instantiates the shared Unsynchronizedlnteger object number 
and uses it as the argument to the constructors for the Producelnteger object pro¬ 
ducer and the Consume Integer object consumer. Next, the program invokes the 
Thread class start method on objects producer and consumer to place them in the 
ready state (lines 16-17). This statement launches the two threads. Lines 20-21 call 
Thread method join to ensure that the main program waits indefinitely for both threads 
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to terminate before continuing. Notice that line 23 is executed after both threads have ter- 
minated. 

Class Producelnteger —a subclass of threading. Thread —consists of 
attribute sharedOb ject, a constructor (lines 11-15) and a run method (lines 17-25). 
The constructor initializes attribute sharedOb ject to refer to the Unsynchronized- 
Integer object passed as an argument. 


1 # Fig. 19.4: Producelnteger.py 

2 # Class that produces integers 

3 

4 import threading 

5 import random 

6 import time 

7 

8 class Producelnteger( threading.Thread ): 

9 """Thread to produce integers""" 

10 

def _ init_( self, threadName, sharedObject ): 

12 

13 

threading.Thread._init_( self, name = threadName ) 

15 self.sharedObject = sharedObject 

16 

def run( self ): 

18 """Produce integers in range 1-10 at random interval 

19 

for i in range( , ): 

time.sleep( random.randrange( ) ) 

self.sharedObject.setSharedNumber ( i ) 

23 

24 print self.getName() , 

25 print , self.getName() 


Fig. 19.4 An integer-producer thread, 

Class ProduceInteger’s run method consists of a for structure that loops ten 
times. Each iteration of the loop first invokes function time . sleep to put the Produ¬ 
celnteger object into the sleeping state for a random time interval between 0 and 3 sec- 
onds. When the thread awakens, it invokes the shared object’s setSharedNumber 
method (line 22) with the value of control variable i to set the shared object’s data member. 
When the loop completes, the Producelnteger thread displays a line in the command 
window indicating that it has finished producing data and terminates (i.e., the thread dies). 

Class Consumelnteger —a subclass of threading . Thread —consists of 
attribute sharedObject, a constructor (lines 11-15) and a run method (lines 17-29). 
The constructor initializes attribute sharedObject to refer to the Unsynchronized- 
Integer object passed as an argument. 


1 # Fig. 19.5: Consumelnteger.py 

2 # Class that consumes integers 

Fig. 19.5 An integer-consumer thread (part 1 of 2). 
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4 import threading 

5 import random 

6 import time 

7 

8 class Consumelnteger( threading.Thread ): 

9 """Thread to consume integers""" 

10 

def _ init_( self, threadName, sharedObject ): 

12 

13 

14 threading.Thread. init ( self, name = threadName ) 

15 self.sharedObject = sharedObject 

16 

def run( self ): 

18 
19 

sum = 

21 

22 # consume 10 values 

23 for i in range( ): 

24 time.sleep( random.randrange( ) ) 

sum += self.sharedObject.getSharedNumber() 

26 

print % \ 

28 ( self.getName () , sum ) 

print , self.getName() 

Fig. 19.5 An integer-consumer thread (part 2 of 2). 

Class ConsumeInteger’s run method consists of a for structure that loops ten 
times toread values from the Unsynchronizedlnteger object to which sharedOb¬ 
ject refers. Each iteration of the loop invokes function time . sleep to put the Con¬ 
sumelnteger object into the sleeping state for a random time interval between 0 and 3 
seconds. Next, the thread calls the getSharedNumber method to get the value of the 
shared object’s data member. Then, the thread adds to variable sum the value returned by 
getSharedlnt (line 25). When the loop completes, the Consumelnteger thread dis- 
plays a line in the command window indicating that it has finished consuming data and ter- 
minates (i.e., the thread dies). 

Class UnsynchronizedInteger’s setSharedNumber method (lines 14-19) 
and getSharedNumber method (lines 21-28) do not synchronize access to instance 
variable sharedNumber (created in line 12). Ideally, we would like every value pro- 
duced by the Producelnteger object to be consumed exactly once by the Con¬ 
sumelnteger object. However, the output of Fig. 19.3 reveals that the values 1, 6, 7, 8 
and 10 are lost (i.e., never seen by the consumer) and the values 2, 4 and 9 are retrieved 
more than once by the consumer. 


1 # Fig. 19.6: Unsynchronizedlnteger.py 

2 # Unsynchronized access to an integer 

3 

Fig. 19.6 Unsynchronized integer value class (part 1 of 2). 
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— 3 import threading 

5 

6 class Unsynchronizedlnteger: 

7 

8 

def _init_( self ): 

10 """Initialize shared number to -1 . 

11 

12 self.sharedNumber = 

13 

14 def setSharedNumber( self, newNumber ): 

15 "Set value of ntegei 

16 

17 print % \ 

( threading.currentThread().getName(), newNumber ) 

19 self.sharedNumber = newNumber 

20 

21 def getSharedNumber( self ): 

22 

23 

24 tempNumber = self.sharedNumber 

25 print % \ 

( threading.currentThread().getName(), tempNumber ) 

27 

28 return tempNumber 


Fig. 19.6 Unsynchronized integer value class (part2 of 2). 

In fact, method getSharedNumber must perform some “tricks” to make the output 
accurately reflect the value of the data member. Line 24 assigns the value of data member 
sharedNumber to variable tempNumber. Lines 25-28 then use the value of temp¬ 
Number to print the message and return the value. If we did not use a temporary variable 
in this way, the following scenario could occur. The consumer could call method get¬ 
SharedNumber and print a message that displays the value of the data member. The 
interpreter might then switch out the consumer thread for the producer thread. The producer 
thread might then change the value of sharedNumber any number of times by calling 
method setSharedNumber. Eventually, the interpreter switches the consumer back in 
and method getSharedNumber returns a value different that the value printed before 
the consumer was switched out. 

This example clearly demonstrates that access to shared data by concurrent threads 
must be controlled carefully or a program may produce incorrect results. To solve the prob- 
lems of lost data and doubled data in the previous example, we must synchronize access to 
the shared data for the concurrent producer and consumer threads. 


19.7 Producer/Consumer Relationship With Thread 
Synchronization 

The program in Fig. 19.7 demonstrates a producer and a consumer accessing a shared cell 
of memory with synchronization, so that the consumer consumes exactly one time after the 
producer produces each value. The program differs only in that it passes an object of class 
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Synchronizedlnteger to the producer and consumer. Classes Producelnteger 

and Consuraelnteger are identical to the previous section. 


1 # Fig. 19.7: figl9_07.py 

2 # Show multiple threads modifying shared object. 

3 

4 from Synchronizedlnteger import Synchronizedlnteger 

5 from Producelnteger import Producelnteger 

6 from ConsumeInteger import ConsumeInteger 

7 

8 # initialize number and threads 

9 number = Synchronizedlnteger() 

10 producer = Producelnteger( , number ) 

11 consumer = Consumelnteger( , number ) 

12 

13 print arting threads.. \n' 

14 

15 # start threads 

16 producer.start() 

17 consumer.start() 

18 

19 # wait for threads to terminate 

20 producer.join() 

21 consumer.join() 

22 

23 print "\nAll threads have terminated." 


Fig. 19.7 Threads modifying a synchronized shared object (part 1 of 2). 
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Starting threads... 

Producer setting sharedNumber to 1 
Consumer retrieving sharedNumber value 1 
Producer setting sharedNumber to 2 
Consumer retrieving sharedNumber value 2 
Producer setting sharedNumber to 3 
Consumer retrieving sharedNumber value 3 
Producer setting sharedNumber to 4 
Consumer retrieving sharedNumber value 4 
Producer setting sharedNumber to 5 
Consumer retrieving sharedNumber value 5 
Producer setting sharedNumber to 6 
Consumer retrieving sharedNumber value 6 
Producer setting sharedNumber to 7 
Consumer retrieving sharedNumber value 7 
Producer setting sharedNumber to 8 
Consumer retrieving sharedNumber value 8 
Producer setting sharedNumber to 9 
Consumer retrieving sharedNumber value 9 
Producer setting sharedNumber to 10 
Producer finished producing values 
Terminating Producer 

Consumer retrieving sharedNumber value 10 
Consumer retrieved values totaling: 55 
Terminating Consumer 

All threads have terminated. 


Fig. 19.7 Threads modifying a synchronized shared object (part 2 of 2). 

Class Synchronizedlnteger (Fig. 19.8) contains three attributes— shared¬ 
Number, writeable and threadCondition, a condition variable. Method set- 
SharedNumber uses the condition variable to determine if the thread that calls the 
method can write to the shared memory location. Method getSharedNumber uses the 
condition variable to determine if the calling thread can read from the shared memory loca¬ 
tion. Line 14 creates the thread condition variable by invoking the threading. Condi¬ 
tion constructor. Because no argument (i.e., an underlying lock) is passed to the condition 
variable’s constructor, a new lock will be created for the condition variable. 


1 # Fig. 19.8: Synchronizedlnteger.py 

2 # Synchronized access to an integer with condition variable 

3 

4 import threading 

5 

6 class Synchronizedlnteger: 

7 """Class that provides synchronized access an integer""" 

8 

def _init_( self ): 

10 

Fig. 19.8 Synchronized integer value class (part 1 of 2). 
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self.sharedNumber = 
self.writeable = 

self.threadCondition = threading.Condition() 
def setSharedNumber( self, newNumber ): 


# block until lock released then acquire lock 

self.threadCondition.acquire() 

# while not producer's turn, release lock and block 

while not self.writeable: 

self.threadCondition.wait() 

# (lock has now been re-acquired) 

print % \ 

( threading.currentThread().getName(), newNumber ) 
self.sharedNumber = newNumber 

self.writeable = 
self.threadCondition.notify() 
self.threadCondition.release () 

def getSharedNumber( self ): 


# block until lock released then 

self.threadCondition.acquire() 

# while producer's turn, release 

while self.writeable: 

self.threadCondition.wait() 

# (lock has now been re-acquired) 

tempNumber = self.sharedNumber 

print % \ 

( threading.currentThread().getName(), tempNumber ) 

self.writeable = 

self.threadCondition.notify() 

self.threadCondition.release() 

return tempNumber 


allow consumer to consume 
wake up a waiting thread 
allow lock to be acquired 

acquire lock 

lock and block 


Fig. 19.8 Synchronized integer value class (part 2 of 2). 

The constructor (lines 9-14) creates attribute writeable and initializes its value to 
1. The class’ condition variable— threadCondition —protects access to attribute 
writeable. If writeable is 1, a producer can place a value into variable shared- 
Number. However, this means that a consumer currently cannot read the value of 
sharedNumber. If writeable is 0, a consumer can read a value from variable 
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sharedNumber. However, this means that a producer currently cannot place a value into 

sharedNumber. 

When the Producelnteger thread object invokes method setSharedNumber 
(lines 16-34), a lock is acquired on the condition variable (line 20). The while struc¬ 
ture in lines 23-24 tests the writeable data member. If writeable is 0, line 24 
invokes the condition variable’s wait method. This call places the Producelnteger 
thread object that called method setSharedNumber into the waiting state and releases 
the lock on the Synchronizedlnteger object so other objects may access it. 

The Producelnteger object remains in the waiting state until it is notified that it 
may proceed—at which point it enters the ready state and waits for the interpreter to exe- 
cute it. When the Producelnteger object reenters the running state, the object implic- 
itly reacquires the lock on the condition variable, and the setSharedNumber method 
continues executing in the while structure with the next statement after wait. There are 
no more statements, so the while condition is tested again. If the condition is true (i.e., 
writeable is 0), the program displays a message indicating that the producer is setting 
sharedNumber to a new value, newNumber (the argument passed to setShared¬ 
Number). writeable is set to 0 to indicate that the shared memory is now full (i.e., a 
consumer can read the value and a producer cannot put another value there yet) and condi¬ 
tion variable method notif y is invoked. If there are any waiting threads, one thread in the 
waiting state is placed into the read y state, indicating that the thread can now attempt its 
task again (as soon as it is switched into the interpreter). Lines 34 then calls condition vari¬ 
able method release, and method setSharedNumber returns to its caller. 



-.Common Programming Error 19.2 


Condition variable method notifydoes not release the underlying lock. Forgetting to call 
release can resuit in deadlock. 


Methods getSharedNumber and setSharedNumber are implemented simi- 
larly. When the Consumelnteger object invokes method getSharedNumber, the 
method acquires a lock on the condition variable object. The while structure in lines 43- 
44 tests variable writeable. If writeable is 1 (i.e., there is nothing to consume), the 
condition variable’s wait method is invoked. This places the Consumelnteger thread 
object that called method getSharedNumber into the waiting state and releases the lock 
on the Synchronizedlnteger object so other objects may access it. The Con¬ 
sumelnteger object remains in the waiting state until it is notified that it may proceed— 
at which point it enters the ready state and waits for the interpreter to switch it in. When the 
Consumelnteger object reenters the running state, the setSharedNumber method 
reacquires the lock on the condition variable object and the method continues executing in 
the while structure with the next statement after wait. There are no more statements, so 
the while condition is tested again. If the condition is 0, the value of sharedNumber is 
stored in variable tempNumber (line 48) and the method outputs a message to the com- 
mand window indicating that the consumer is retrieving sharedNumber. Note that the 
value of sharedNumber is only retrieved once and stored in variable tempNumber 
(while within the critical section). Lines 49 and 56 (outside the critical section) use the 
value of tempNumber rather than sharedNumber to ensure that they use the same 
value. 
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Next, writeable is set to 1 to indicate that the shared memory is now empty, and 
condition variable method notify is invoked. If there are any waiting threads, one thread 
in the waiting state is placed into the ready state, indicating that the thread can now attempt 
its task again (as soon as it is assigned a processor). Line 54 releases the lock on the condi¬ 
tion variable, and line 56 returns the value of tempNumber to getSharedNumber’s 
caller. 

The output in Fig. 19.7 shows that every integer produced is consumed once—no 
values are lost and no values are doubled. Also, the consumer cannot read a value until the 
producer produces a value. The next section addresses a way for consumers and producers 
to read and write multiple values simultaneously. 


19.8 Producer/Consumer Relationship: The Circular Buffer 

The program of Fig. 19.7 does access the shared data correctly, but it may not perform op- 
timally. Because the threads are running asynchronously, we cannot predict their relative 
speeds. If the producer wants to produce faster than the consumer can consume, it cannot 
do so. To enable the producer to continue producing we can use a circular buffer which has 
enough cells to handle the “extra” production. The program of Fig. 19.9 demonstrates a 
producer and a consumer accessing a synchronized circular buffer (in this case, a shared list 
of five cells). Consumer only consumes a value when the list contains one or more values; 
the producer only produces a value when the list contains one or more available cells. 


1 # Fig. 19.9: figl9_09.py 

2 # Show multiple threads modifying shared object. 

3 

4 from SynchronizedCells import SynchronizedCells 

5 from ProduceInteger import ProduceInteger 

6 from ConsumeInteger import ConsumeInteger 

7 

8 # initialize number and threads 

9 number = SynchronizedCells() 

10 producer = Producelnteger( , number ) 

11 consumer = Consumelnteger( , number ) 

12 

13 print "Starting threads...\n" 

14 

15 # start threads 

16 producer.start() 

17 consumer.start() 

18 

19 # wait for threads to terminate 

20 producer.join() 

21 consumer.join() 

22 

23 print "\nAll threads have terminated." 


Fig. 19.9 Threads modifying a synchronized circular buffer (part 1 of 2), 
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Starting threads... 
WAITING TO CONSUME 


Produced 1 

into 

cell 

0 

write 

1 

read 

0 

[1, 

-1, -1, -1, -1] 

Consumed 1 

from 

cell 

0 

write 

1 

read 

1 

[-1, 

-1, -1, -1, -1] 

BUFFER EMPTY 









Produced 2 

into 

cell 

1 

write 

2 

read 

1 

[-1, 

2, -1, -1, -1] 

Produced 3 

into 

cell 

2 

write 

3 

read 

1 

[-1, 

2, 3, -1, -1] 

Produced 4 

into 

cell 

3 

write 

4 

read 

1 

[-1, 

2, 3, 4, -1] 

Consumed 2 

from 

cell 

1 

write 

4 

read 

2 

[-1, 

- 1 , 3, 4, -1] 

Produced 5 

into 

cell 

4 

write 

0 

read 

2 

[-1, 

-1, 3, 4, 5] 

Produced 6 

into 

cell 

0 

write 

1 

read 

2 

[6, 

-1, 3, 4, 5] 

Produced 7 

BUFFER FULL 

into 

cell 

1 

write 

2 

read 

2 

[6, 

7, 3, 4, 5] 

WAITING TO PRODUCE 8 








Consumed 3 

from 

cell 

2 

write 

2 

read 

3 

[6, 

7, -1, 4, 5] 

Produced 8 

into 

cell 

2 

write 

3 

read 

3 

[6, 

7, 8, 4, 5] 

BUFFER FULL 

Consumed 4 

from 

cell 

3 

write 

3 

read 

4 

[6, 

7, 8, -1, 5] 

Produced 9 

BUFFER FULL 

into 

cell 

3 

write 

4 

read 

4 

[6, 

7, 8, 9, 5] 

WAITING TO PRODUCE 10 








Consumed 5 

from 

cell 

4 

write 

4 

read 

0 

[6, 

7, 8, 9, -1] 

Produced 10 

BUFFER FULL 

into 

cell 

4 

write 

0 

read 

0 

[6, 

7, 8, 9, 10] 

Producer finished producing values 





Terminating 

Producer 








Consumed 6 

from 

cell 

0 

write 

0 

read 

1 

[-1, 

7, 8, 9, 10] 

Consumed 7 

from 

cell 

1 

write 

0 

read 

2 

[-1, 

-1, 8, 9, 10] 

Consumed 8 

from 

cell 

2 

write 

0 

read 

3 

[-1, 

-1, - 1 , 9, 10] 

Consumed 9 

from 

cell 

3 

write 

0 

read 

4 

[-1, 

-1, -1, -1, 10] 

Consumed 10 

from 

cell 

4 

write 

0 

read 

0 

[-1, 

-1, -1, -1, -1] 


BUFFER EMPTY 

Consumer retrieved values totaling: 55 
Terminating Consumer 

All threads have terminated. 


Fig. 19.9 Threads modifying a synchronized circular buffer (part 2 of 2), 

Class SynchronizedCells (Fig. 19.10) contains six attributes— sharedCells 
is a five-element list of integers that represents the circular buffer, writeable indicates 
whether a producer can write into the circular buffer, readable indicates whether a con¬ 
sumer can read from the circular buffer, readLocation indicates the current position 
from which the next value can be read by a consumer, writeLocation indicates the 
next location in which a value can be placed by a producer and threadCondition is 
the condition variable that protects access to the buffer. 


1 # Fig. 19.10: SynchronizedCells.py 

2 # Synchronized circular buffer of integer values 

Fig. 19.10 Synchronized circular buffer of integers (part 1 of3). 
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import threading 
class SynchronizedCells : 
def _init_( self ): 


self.sharedCells = [ 
self.writeable = 
self.readable = 
self.writeLocation = 
self.readLocation = 

self.threadCondition = 

def setSharedNumber( self 


, , , , ] 

# buffer may be changed 

# buffer may not be read 

# current writing index 

# current reading index 

threading.Condition() 
newNumber ): 


# block until lock released then acquire lock 

self.threadCondition.acquire() 

# while buffer is full, release lock and block 

while not self.writeable: 

print , newNumber 

self.threadCondition.wait() 

# buffer is not full, lock has been re-acquired 

# produce a number in shared cells, consumer may consume 

self.sharedCells[ self.writeLocation ] = newNumber 
self.readable = 

print % \ 

( newNumber, self.writeLocation ), 

# set writing index to next place in buffer 

self.writeLocation = ( self.writeLocation + ) % 

print % \ 

( self.writeLocation, self.readLocation ), 
print self.sharedCells 

# if producer has caught up to consumer, buffer is full 

if self.writeLocation == self.readLocation: 
self.writeable = 

print "BUFFER FULL 

self.threadCondition.notify() 
self.threadCondition.release() 

def getSharedNumber ( self ) : 


# block until lock released then acquire lock 


Fig. 19.10 Synchronized circular buffer of integers (part 2 of 3), 
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self.threadCondition.acquire() 

# while buffer is empty, release lock and block 

while not self.readable: 

print 'WAITING TO CONSUME 

self.threadCondition.wait() 

# buffer is not empty, lock has been re-acquired 

# consume a number from shared cells, producer may produce 

self.writeable = 

tempNumber = self.sharedCells[ self.readLocation ] 
self.sharedCells[ self.readLocation ] = 

print % \ 

( tempNumber, self.readLocation ), 

# move to next produced number 

self.readLocation = ( self.readLocation + ) % 

print % \ 

( self.writeLocation, self.readLocation ), 
print self.sharedCells 

# if consumer has caught up to producer, buffer is empty 

if self.readLocation == self.writeLocation: 
self.readable = 

print 'BUFFER EMPTY" 

self.threadCondition.notify() 
self.threadCondition.release () 

return tempNumber 


Fig. 19.10 Synchronized circular buffer of integers (part 3 of 3), 

Method setSharedNumber (lines 19-51) performs the same tasks as it did in 
Fig. 19.8 with a few modifications. When execution continues at line 33 after the while 
loop, the produced value is placed into the circular buffer at location writeLocation. 
Next, readable is set to 1 because there is at least one value in the buffer to be read. The 
method prints the produced value and the cell in which the value was placed. Then, 
writeLocation is updated for the next call to setSharedNumber. Note that the 
value of writeLocation is kept in range 0-4, inclusive, using the % operator. The 
output is continued with the current writeLocation and readLocation values and 
the values in the circular buffer. If the writeLocation is equal to the readLocation, 
the circular buffer currently is full, so writeable is set to 0 and the string "BUFFER 
FULL" is displayed. Next, condition variable method notify is invoked to indicate that 
a waiting thread should move to the ready state. Finally, condition variable method 
release is invoked to release the condition variable’s underlying lock. 

Method getSharedNumber (line 53-89) also performs the same tasks in this 
example as it did in Fig. 19.8 with a few modifications. When execution continues at line 
67 after the while loop, writeable is set to 1 because there is at least one open position 
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in the buffer in which a value can be placed. Next, the method assigns to tempNumber 
the value at location readlocation in the circular buffer. Line 69 sets the value at loca- 
tion readlocation in the buffer to -1, indicating it is an empty spot. The value con- 
sumed and the cell from which the value was read are printed. Then, the method updates 
attribute readLocation for the next call to method getSharedNumber. The output 
continues with the current writeLocation and readlocation values and the cur¬ 
rent values in the circular buffer. If the readlocation is equal to the writeLoca¬ 
tion, the circular buffer is currently empty, so readable is set to 0 and the string 
"BUFFEREMPTY" is displayed. Next, line 86 invokes condition variable method notify 
to place the next waiting thread into the ready state. Line 87 invokes condition variable 
method release to release the condition variable’s underlying lock. Finally, line 89 
returns the retrieved value to the calling thread. 

We have modified the program of Fig. 19.9 to include the current writeLocation 
and readlocation values. We also display the current contents of the buffer shared- 
Cells. The elements of the sharedCells list were initialized to -1 for output purposes 
so you can see each value inserted into the buffer. Notice that after the fifth value is placed 
in the fifth element of the buffer, the sixth value is inserted at the beginning of the list— 
thus providing the circular buffer effect. 


19.9 Semaphores 

A semaphore is a variable that Controls access to a common resource or a critical section. 
A semaphore maintains a counter that specifies the number of threads that can use the re¬ 
source or enter the critical section. The counter is decremented each time a thread acquires 
the semaphore. When the counter is zero, the semaphore blocks any other threads until the 
semaphore has been released by another thread. Figure 19.11 uses a restaurant scenario to 
demonstrate using semaphores to control access to a critical section. 


1 # Figure 19.11: figl9_ll.py 

2 # Using a semaphore to control access to a critical section 

3 

4 import threading 

5 import random 

6 import time 

7 

8 class SemaphoreThread( threading.Thread ): 

9 
10 

availableTables =[,,,, ] 

12 

def _init_( self, threadName, semaphore ): 

14 'Initialize thread""' 

15 

threading.Thread._init_( self, name = threadName ) 

self.sleepTime = random.randrange( , ) 

18 

19 # set the semaphore as a data attribute of the class 

20 self.threadSemaphore = semaphore 


Fig, 19.11 Using a semaphore to control access to a critical section (part 1 of 3), 
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def run( self ): 


# acquire the semaphore 

self.threadSemaphore.acquire() 

# remove a table from the list 

table = SemaphoreThread.availableTables.pop() 
print % \ 

( self.getName(), table ), 
print SemaphoreThread.availableTables 

time.sleep( self.sleepTime ) 

# free a table 

print % \ 

( self.getName(), table ), 

SemaphoreThread.availableTables.append( table ) 
print SemaphoreThread.availableTables 

# release the semaphore after execution finishes 

self.threadSemaphore.release() 

threads = [] 

# semaphore allows five threads to enter critical section 

threadSemaphore = threading.Semaphore( 

len( SemaphoreThread.availableTables ) ) 

# create ten threads 

for i in range( , ): 

threads.append( SemaphoreThread( + str( i ), 

threadSemaphore ) ) 

# start each thread 

for thread in threads: 
thread.start() 


Fig. 19.11 Using a semaphore to control access to a critical section (part 2 of 3), 
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Fig. 19.11 Using a semaphore to control access to a critical section (part 3 of 3), 


Lines 48-49 create a threading. Semaphore instance that allows five threads to 
access the critical section at a time. Lines 52-54 create a list of SemaphoreThread 
instances. Method start starts each thread in the list (lines 57-58). 

Class SemaphoreThread (lines 8^43) represents a single customer at a restaurant. 
Class attribute availableTables (line 11) keeps track of the available tables in the res¬ 
taurant. 

A semaphore has a built-in counter to keep track of the number of calls to its acquire 
and release methods. If the counter is greater than zero, method acquire (line 26) 
obtains the semaphore for the thread and decrements the counter. If the counter is zero, the 
thread blocks until another thread releases the semaphore. 

List method pop (line 29) removes the last item from availableTables as 
another thread begins executing the critical section. The program displays which thread 
entered the critical section and the thread sleeps for a randomly determined time. Line 39 
appends the removed item to availableTables as a thread prepares to exit the critical 
section. 

Semaphore method release (line 43) releases the semaphore when the thread fin- 
ishes executing the critical section. The method call increments the counter and notifies a 
waiting thread. 

Note that if lines 26 and 43 are removed from Fig. 19.11, more than five threads may 
attempt to remove an item from the shared list, resulting in an IndexError exception. 


19.10 Events 

Module threading defines class Event, which is useful for thread communication. An 
Event object has an internal flag, which is either true or false. One or more threads may 
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call the Event object’s wait method to block until the event occurs. When the event oc- 
curs, the blocked thread or threads are notified and resume execution. Figure 19.12 illus- 
trates a situation where a traffic light turns green every 3 seconds. 
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# Fig. 19.12: figl9_12.py 

# Demonstrating Event objects 

import threading 
import random 
import time 

class VehicleThread( threading.Thread ) : 


def _ init_( self, threadName, event ): 

threading.Thread._init_( self, name = threadName ) 

# ensures that each vehicle waits for a green light 

self.threadEvent = event 

def run( self ): 


# stagger arrival times 

time.sleep( random.randrange( , ) ) 

# prints arrival time of car at intersection 

print % \ 

( self.getName(), time.ctime( time.time() ) ) 

# flag is false until two vehicles are queued 

self.threadEvent.wait() 

# displays time that car departs intersection 

print % \ 

( self.getName(), time.ctime( time.time() ) ) 

greenLight = threading.Event() 
vehicleThreads = [] 

# creates and starts ten Vehicle threads 

for i in range( , ): 

vehicleThreads.append( VehicleThread( + str( i ), 

greenLight ) ) 

for vehicle in vehicleThreads: 
vehicle.start() 

while threading.activeCount() > 

# sets the Event object's flag to false 


Fig. 19.12 Traffic light example demonstrating an Event object (part 1 of2). 
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"50 greenLight. ciear () 

51 print 

52 

53 time.sleep( ) 

54 

55 # sets the Event object's flag to true 

56 print GREEN LIGHT 

57 greenLight.set() 


RED LIGHT! 

Vehicle4 arrived at Mon Aug 20 16:58:33 2001 

Vehicle8 arrived at Mon Aug 20 16:58:33 2001 

Vehicle9 arrived at Mon Aug 20 16:58:35 2001 

VehiclelO arrived at Mon Aug 20 16:58:35 2001 
GREEN LIGHT! 


Vehicle4 passes through intersection at Mon Aug 20 16:58:35 2001 

Vehicle8 passes through intersection at Mon Aug 20 16:58:35 2001 

Vehicle9 passes through intersection at Mon Aug 20 16:58:35 2001 

VehiclelO passes through intersection at Mon Aug 20 16:58:35 2001 


RED LIGHT! 


Vehicle2 arrived at Mon 
Vehicle5 arrived at Mon 
Vehicle7 arrived at Mon 
GREEN LIGHT! 


Aug 20 16:58:36 2001 
Aug 20 16:58:37 2001 
Aug 20 16:58:37 2001 


Vehicle2 passes through 
Vehicle5 passes through 
Vehicle7 passes through 
RED LIGHT! 


intersection at Mon Aug 
intersection at Mon Aug 
intersection at Mon Aug 


20 

20 

20 


Vehiclel arrived at Mon 
Vehicle6 arrived at Mon 
Vehicle3 arrived at Mon 
GREEN LIGHT! 


Aug 20 16:58:39 2001 
Aug 20 16:58:40 2001 
Aug 20 16:58:41 2001 


Vehiclel passes through 
Vehicle6 passes through 
Vehicle3 passes through 


intersection 

intersection 

intersection 


at Mon Aug 20 
at Mon Aug 20 
at Mon Aug 20 


16:58:38 2001 
16:58:38 2001 
16:58:38 2001 


16:58:41 2001 
16:58:41 2001 
16:58:41 2001 


Fig. 19.12 Traffic light example demonstrating an Event object (part 2 of 2). 


Line 36 creates an Event instance— greenLight —which simulates a traffic light. 
Lines 40-42 create a list of VehicleThreads. Class VehicleThread (lines 8-34) 
represents a vehicle at the intersection as a thread. Lines 45-46 start each vehicle thread. 
Each thread sleeps for a random amount of time, prints an arrival message, waits until the 
traffic light is green (i.e., greenLight’s internal flag is true) and prints a departing mes¬ 
sage. 

The while structure in lines 48-58 loops until only the main thread is left (i.e., all 
vehicle threads have terminated). Each iteration calls Event method ciear, sleeps for 3 
seconds and calls Event method set. Event methods ciear and set change the value 
of an internal flag to false and true, respectively. 
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19.11 Daemon Threads 

A daemon thread is a thread that runs for the benefit of other threads. Daemon threads run 
in the background (i.e., when processor time is available that would otherwise go to waste). 
Unlike conventional user threads, daemon threads do not prevent a program from terminat- 
ing. The garbage collector is a daemon thread. Non-daemon threads are conventional user 
threads. We designate a thread as a daemon with the method call 

setDaemon( ) 

An argument of 0 means that the thread is not a daemon thread. A program can include a 
mixture of daemon threads and non-daemon threads. When only daemon threads remain in 
a program, the program exits. If a thread is to be a daemon, it must be set as such before its 
start method is called; otherwise, setDaemon raises an AssertionError excep- 
tion. Method isDaemon returns 1 if a thread is a daemon thread and returns 0 otherwise. 

SUMMARY 

[***To be done for second round of review***] 

TERMINOLOGY 

[***To be done for second round of review***] 

SELF-REVIEW EXERCISES 

[***To be done for second round of review***] 

ANSWERS TO SELF REVIEW EXERCISES 

[***To be done for second round of review***] 

EXERCISES 

[***To be done for second round of review***] 
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Notes to Reviewers: 


• Please mark your comments in place on a paper copy of the chapter. 

• Please retum only marked pages to Deitel & Associates, Inc. 

• Please do not send e-mails with detailed, line-by-line comments; mark these directly on the paper 
pages. 

• Please feel free to send any lengthy additional comments by e-mail to 

ben. wiedermann@dei.tel .net. 

• Please run ali the code examples. 

• Please check that we are using the correct programming idioms. 

• Please check that there are no inconsistencies, errors or omissions in the chapter discussions. 

• The manuscript is being copy edited by a professional copy editor in parallel with your reviews. 
That person will probably find most typos, spelling errors, grammatical errors, etc. 

• Please do not rewrite the manuscript. We are mostly concerned with technical correctness and cor¬ 
rect use of idiom. We will not make significant adjustments to our writing or coding style on a 
global scale. Please send us a short e-mail if you would like to make a suggestion. 

• If you find something incorrect, please show us how to correct it. 

• In the later round(s) of review, please read all the back matter, including the exercises and any So¬ 
lutions we provide. 

• Please review the index we provide with each chapter to be sure we have covered the topics you 
feel are important. 
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Objectives 

• To understand the elements of Python networking 
with URLs, sockets and datagrams. 

• To implement Python networking applications using 
sockets and datagrams. 

• To understand how to implement Python clients and 
servers that communicate with one another. 

• To understand how to implement network-based 
collaborative applications. 

• To construet a multithreaded server. 

Ifthe presence of electricity can be made visible in any part 
of a circuit, I see no reason why intelligence may not be 
transmitted instantaneously by electricity. 

Samuel F. B. Morse 

Mr. Watson, come here, Iwantyou. 

Alexander Graham Bell 

What networks of railroads, highways and canals were in 
another age, the networks of telecommunications, 
information and computerization ... are today. 

Bruno Kreisky, Austrian Chancellor 
Science may never come up with a better office- 
communication system than the cojfee break. 

Earl Wilson 

It’s currently a problem ofaccess to gigabits through 
punybaud. 

J. C. R. Licklider 



Under 

Constructi on 
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Outline 

20.1 Introduction 

20.2 Accessing URLs over HTTP 

20.3 Establishing a Simple Server (Using Stream Sockets) 

20.4 Establishing a Simple Client (Using Stream Sockets) 

20.5 Client/Server Interaction with Stream Socket Connections 

20.6 Connectionless Client/Server Interaction with Datagrams 

20.7 Client/Server Tic-Tac-Toe Using a Multithreaded Server 

Summary • Terminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 


20.1 Introduction 


In this chapter, our discussion focuses on several fundamental networking technologies that 
can be used to build distributed applications. We revisit the client/server relationship be- 
tween World Wide Web browsers and World Wide Web servers to demonstrate a script that 
causes the Web browser to load a new Web page. 

Because Python is such a high-level language, networking tasks that take a great deal 
of code and effort in other languages can be accomplished easily and simply in Python. This 
chapter highlights the most frequently used Python networking capabilities. We demon¬ 
strate module urllib and its ability to obtain a document downloaded from the World 
Wide Web. 

We also introduce Python’s socket-based Communications, which enable applications 
to view networking as if it were file I/O—a program can receive from a socket or send to a 
Socket as simply as reading from a file or writing to a file. We show how to create and 
manipulate sockets. 

Python provides stream sockets and datagram sockets. With stream sockets a process 
establishes a connection to another process. While the connection is in place, data flows 
between the processes in continuous streams. Stream sockets are said to provide a connec- 
tion-oriented Service. The protocol used for transmission is the popular TCP (Transmission 
Control Protocol). 

With datagram sockets, individual packets of information are transmitted. This is not 
the right protocol for everyday users because unlike TCP, the protocol used, UDP —the 
User Datagram Protocol, is a connectionless Service, and does not guarantee that packets 
arrive in any particular order. In fact, packets can be lost, can be duplicated and can even 
arrive out of sequence. So with UDP, significant extra programming is required on the 
user’s part to deal with these problems (if the user chooses to do so). Stream sockets and 
the TCP protocol will be the most desirable for the vast majority of Python programmers. 



Performance Tip 20.1 

Connectionless ser\>ices generally offer greaterperformance but less reliability than connec- 
tion-oriented Services. 
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Portability Tip 20.1 

The TCPprotocol and its related set of protocols enable a great variety of heterogeneous 
computer systems (i.e., computer systems with different processors and different operating 
systems) to intercommunicate. 


Once again, we will see that many of the networking details for the examples in this 
chapter are handled by the Python modules we use. 


20.2 Accessing URLs over HTTP 

The Internet offers many protocols. The http protocol (HyperText Transfer Protocol) that 
forms the basis of the World Wide Web uses URLs (Uniform Resource Locators, also 
called Universal Resource Locators) to locate data on the Internet. Common URLs repre- 
sent files or directories and can represent complex tasks such as database lookups and In¬ 
ternet searches. If you know the URL of publicly available XHTML files anywhere on the 
World Wide Web, you can access that data through http. 

Figure 20.1 uses Tkinter and Pmw GUI components to display the contents of a file 
on a Web server. We define class WebBrowser that acts as a simple Web browser. The 
user inputs the URL in the Entry at the top of the window and the corresponding Web 
document (if it exists) is displayed in the ScrolledText. 


1 # Fig. 20.1: fig20_01.py 

2 # This program displays the contents of a file on a Web server. 

3 

4 from Tkinter import * 

5 import Pmw 

6 import urllib 

7 import urlparse 

8 

9 class WebBrowser! Frame ): 

10 "A simple Web browser" 

11 

12 def _init_( self ): 

13 "Create the Web browser GUI" 

14 

15 Frame._init_( self ) 

Pmw.initialise() 

17 self.pack( expand = , fili = 

18 self.master.title( 

19 self.master.geometry( ) 

20 

21 self.address = Entry( self ) 

self.address.pack( fili = , padx = , pady = ) 

23 self.address.bind( , self.getPage ) 

24 

25 self.contents = Pmw.ScrolledText( self, 

26 text_state = ) 

self.contents.pack( expand = , fili = , padx = 

28 pady = ) 

Fig. 20.1 Reading a file through a URL connection (part 1 of 3). 
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79 

30 def getPage( self, event ): 

31 "Parse the URL, add addressing scheme and retr 

32 

33 # parse the URL 

34 myURL = event.widget.get() 
components = urlparse.urlparse( myURL ) 
self.contents.text_state = 

37 

38 # if addressing scheme not specified, use http 

39 if components[ ] == 

40 myURL = + myURL 

41 

42 # connect and retrieve the file 

43 try: 

44 tempFile = urllib.urlopen( myURL ) 

45 self.contents.settext( tempFile.read() 

46 except IOError: 

47 self.contents.settext( 

48 

self.contents.text_state = 

50 

51 def main(): 

52 WebBrowser () .mainloopO 

53 

54 if _ name_ == 

main() 


) # show results 
) 



Fig. 20.1 Reading a file through a URL connection (part 2 of 3). 
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Fig. 20.1 Reading a file through a URL connection (part 3 of 3). 

Class WebBrowser contains an Entry component address, in which the user 
enters the URL of the file to read, and ScrolledText component contents that dis- 
plays the contents of the file. When the user presses the Enter key in the Entry compo¬ 
nent, method getPage executes. Method getPage (lines 30-49) retrieves the specified 
file from the Web server. Line 34 obtains the URL from component address by invoking 
its get method. 

Module urlparse, a module that facilitates the manipulation URLs, parses the URL. 
Function urlparse . urlparse takes a string as input and returns a six-element tuple. 
The first element of the tuple is known as the addressing scheme. This example uses http 
as the addressing scheme. The World Wide Web uses HyperText Transfer Protocol (HTTP) 
to define how Web servers and browsers respond to commands. Entering a URL beginning 
with http directs the Web server to retrieve and transfer the requested URL document. 
Line 39 checks if the user has entered a URL beginning with " http : / / ". If not, the pro- 
gram, assuming that the user has simply forgotten it, adds it to the URL (line 40). 

Lines 43-47 attempt to connect to the Web server and retrieve the file using module 
urllib. Module urllib provides methods for accessing data over the Internet. Line 44 
passes the URL to urllib function urlopen to retrieve the file. The function performs 
a DNS (Doma in Name System or Service ) lookup. DNS translates a domain name, or URL, 
into an IP address , a unique identifier for a computer on a network. The module searches 
the Web server for the requested document. If successful, urlopen returns a Python file 
object. Line 45 reads the file and displays the results in the component contents. If 
urlopen fails, line 47 displays a message to the user. 


20.3 Establishing a Simple Server (Using Stream Sockets) 

Module socket contains the function and class definitions that provide the capabilities to 
build programs that communicate with one another over a network. Establishing a simple 
server in Python requires six steps. Step 1 is to create a socket object. A call to the 
socket constructor 
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Socket = Socket.Socket( family, type ) 

creates a new Socket using the specified address family and type. Argument family can be 
either AF_INET or AF_UNIX. In this chapter, we use only AF_INET. The most common 
values for argument type are SOCKSTREAM (for stream sockets) and SOCKDGRAM (lor 
datagram sockets). Note that these constants are defined in module socket. For the pur- 
poses of our discussion, we assume that we have created a stream socket. Section 20.6 dis- 
cusses datagram sockets. 

Once a socket is created, it must be bound to an address (step 2). A call to a socket 
instance’s bind method such as 


socket.bind( address ) 


binds the socket to the specified address. For a socket created by specifying family 
AF_INET, address must be a two-element tuple in the form (host, port), where host is a 
string representing the remote machine’s hostname or an IP address, and portis a port num- 
ber (i.e., integer). The preceding statement reserves a port where the server waits for con- 
nections from clients. Each client asks to connect to the server on this port. Method bind 
raises the exception socket.error if the port is already in use, the hostname is incorrect 
or the port is reserved. 



Port numbers can be between 0 and 65535. Many operating systems resen>e port numbers 
below 1024 for system Services (such as email and World Wide Web servers). Generally, 
these ports should not be specified as connection ports in userprograms. Infact, some oper¬ 
ating systems require special access privileges to use port numbers below 1024. 


Common Programming Error 20.1 



Specifying a port that is already in use or specifying an invalid port number when creating 
a socket results in an error. 


The socket instance is now ready to receive a connection. In order to do so, the 
socket mustprepare for a connection (step 3). This is done with a call to socket method 
listen of the form 


socket.listen( backlog ) 

where backlog specifies the maximum number of clients that can request connections to the 
server. This value should be at least 1. As connections are received, they are queued. If the 
queue is full, client connections are refused. 

The server socket then waits for a client to connect (step 4) with a call to socket 
method accept 

connection, address = socket.accept() 

The socket waits indefinitely (or blocks ) when it calls method accept. When a client 
requests a connection, the method accepts the connection and returns to the server. Method 
accept returns a two-element tuple of the form ( connection , address ). The First element 
of the returned tuple ( connection ) is a new socket object that the server uses to commu- 
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nicate with the client. The second element ( address ) corresponds to the client’s Internet ad- 
dress. 

Step 5 is the processing phase in which the server and the client communicate. The 
server sends information to the client by invoking socket method send and passing the 
information in the form of a string. Method send retums the number of bytes sent. The 
server receives information from the client with socket method recv. When calling 
recv, the server must specify an integer that corresponds to the maximum amount of data 
that can be received at once. Method recv returns a string representing the received data. 
If the amount of data sent is greater than recv allows, the data is truncated and recv 
returns the maximum amount of data allowed. The excess data is buffered on the receiving 
end. On a subsequent call to recv, the excess data is removed from the buffer (along with 
any additional data the client may have sent since the previous call to recv). 



b Common Programming Error 20.2 

A socket’s send method accepts only a string argument. Trying to pass a value with a dif¬ 
ferent type (e.g., an integer) results in an error. 


In step 6, when the transmission is complete, the server closes the connection by 
invoking the close method on the socket. 



With Python ’s multithreading capabilities, we can easily create multithreaded servers that 
can manage many simultaneous connections with many clients; this multithreaded-server ar- 
chitecture is precisely what is used in popular UNIX, Windows NT and OS/2 network serv¬ 
ers. 



A multithreaded server can be implemented to take the socket returned by each call to ac- 
cept and create a new thread that would manage network I/O across that socket, or a 
multithreaded server can be implemented to maintain a pool oftlireads ready to manage net¬ 
work I/O across the new sockets as they are created. 



Performance Tip 20.2 

In high-performance systems in which memory is abundant, a multithreaded server can be 
implemented to create a pool ofthreads that can be assigned quickly to handle network I/O 
across each new socket as it is created. Thus, when a connection is received, the server 
need not incur the overhead of thread creation. 


20.4 Establishing a Simple Client (Using Stream Sockets) 

In this section, we discuss how to create a client that communicates with a server through 
a socket. Establishing a simple client in Python requires four steps. Step 1 creates a sock¬ 
et to connect to the server. 

socket = socket.socket( family, type ) 

Step 2 connects to the server using socket method connect. Method connect 
takes as input the address of the socket to connect to. For AF_INET client sockets, the call 
to connect has the form 
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Socket.connect( ( host, port ) ) 


where host is a string representing the server’s hostname or IP address, and port is the in¬ 
teger port number that corresponds to the server process. If the connection attempt is suc- 
cessful, the client can now communicate with the server over the socket. A connection 
attempt that fails raises the socket. error exception. 


Common Programming Error 20.3 



A socket. error exception is raised when a server address indicated by a client cannot 
be resolved or when an error occurs while attempting to connect to a server. 


Step 3 is the processing phase in which the client and the server communicate via 
methods send and recv. In step 4 when the transmission is complete, the client closes the 
connection by invoking the close method on the socket. 


20.5 Client/Server Interaction with Stream Socket Connections 

We now present an example (Fig. 20.2 and Fig. 20.3) that uses stream sockets to demon¬ 
strate a simple client!server chat application. The server waits for a client connection at¬ 
tempt. When a client application connects to the server, the server application sends a string 
to the client indicating that the connection was successful, and the client displays the mes- 
sage. Both the client and the server applications allow the user to type a message and send 
it to the other application. When the client or the server sends the string "TERMINATE", 
the connection between the client and the server terminates. The client process terminates, 
and the server waits for the next client to connect. Figure 20.2 contains the definition of the 
server. The definition of the client is given in Fig. 20.3. Sample output showing the execu- 
tion between the client and the server is shown as part of Fig. 20.3. 


1 # Fig. 20.2: fig20_02.py 

2 # Set up a server that will receive a connection 

3 # from a client, send a string to the client, 

4 # and close the connection 

5 

6 import socket 

7 

8 HOST = 

9 PORT = 

10 counter = 

11 

12 # step 1: create a socket 

13 mySocket = socket.socket( socket. , socket. ) 

14 

15 # step 2: bind the socket 

16 mySocket.bind( ( HOST, PORT ) ) 

17 

18 while : 

19 

20 # step 3: prepare for a connection 

Fig, 20.2 The server portion of a stream socket connection between a client and a 
server (part 1 of 2). 
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22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 


print 

mySocket.listen( 


# step 6: close connection 
print "Connection terminati 

connection.close() 


while clientMessage != 


print 


# step 5: process connection 

connection.send( 

clientMessage = connection.recv( 


# step 4: wait for and accept a connection 

connection, address = mySocket.accept () 
counter += 


print clientMessage 
serverMessage = raw_input( 
connection.send( 


clientMessage = connection.recv( 


if not clientMessage: 

break 


, counter, 


+ serverMessage ) 


, address[ 


Fig. 20.2 The server portion of a stream socket connection between a Client and a 
server (part 2 of 2). 

Lines 13-40 set up the server to receive a connection and to process the connection 
when it is received. Line 13 creates socket object mySocket to wait for connections. 
Integer counter (line 10) keeps track of the total number of connections processed. 

Line 16 binds mySocket to port 5000. Note that HOST is the string "127.0.0.1". 
This causes the socket to use localhost, the hostname that corresponds to the machine 
on which the program is running. [Note: We chose to demonstrate the client/server relation- 
ship by connecting between programs executing on the same computer (localhost). Nor- 
mally, this first argument would be a string containing the Internet address of another 
computer.] Lines 18-31 contain a while loop in which the server receives and processes 
each client connection. Line 22 listens for a connection from a client at port 5000. The 
argument to listen is the number of connections that can wait in a queue to connect to 
the server (1 in this example). If the queue is full when a client requests a connection, the 
connection is refused. 

Method listen sets up a listener to wait for a client connection. Once a connection 
is received, socket method accept (line 25) creates a socket object that manages the 
connection. Recall that accept retums a two-element tuple. The first element is a new 
socket instance that we call connection. The second element is the Internet address 
of the client computer that connected to this server (in the form ( host , port) for AF_INET 
sockets). Once a new socket for the current connection exists, line 26 prints a message 
displaying the connection number and the client address. 

Line 29 calls socket method send to send the string " SERVER>>> Connection 
successful" to the client. Line 30 calls socket method recv to receive a string from 
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the client of maximum size 1024 bytes. The while loop in lines 32—40 loops until the 
serverreceives the message "CLIENT>>> TERMINATE". Lines 34-35 check whetherthe 
connection has been closed by the client. When a connection has been closed, recv retums 
an empty string. If this is the case, the break statement exits the loop. Otherwise, line 37 
prints the message received from the client. 

Function raw_input (line 38) reads a string from the user. The server sends this 
string to the client (line 39) and receives a message from the client (line 40). When the 
transmission is complete, line 44 closes the socket. The server awaits the next connection 
attempt from a client. 

In our example, the server receives a connection, processes the connection, closes the 
connection and waits for the next connection. A more likely scenario would be a server that 
receives a connection, sets up that connection to be processed as a separate thread of exe- 
cution and then waits for new connections. The separate threads that process existing con- 
nections can continue to execute while the server concentrates on new connection requests. 
We leave it as an exercise to implement this multithreaded approach to the server applica- 
tion. 

The client is displayed in Fig. 20.3. Sample output from a client/server connection fol- 
lows the code. 


1 

# Fig. 20.3: fig20_03.py 



2 

# Set up a client that will read 

information sent 


3 

A 

# from a server and display that 

information 


5 

A 

import socket 



7 

HOST = 



8 

Q 

PORT = 



10 

# step 1: create a socket 



11 

print "Attempting connection" 



12 

mySocket = socket.socket( socket. 

, socket. 

) 

13 




14 

# step 2: connect to server 



15 

mySocket.connect( ( HOST, PORT ) 

) 


16 

print "Connected to Server" 



17 




18 

# step 3: process connection 



19 

serverMessage = mySocket.recv( 

) 


20 




21 

while serverMessage != 



22 




23 

if not serverMessage: 



24 

break 



25 




26 

print serverMessage 



27 

clientMessage = raw_input( 

) 


28 

mySocket.send( + 

clientMessage ) 


29 

serverMessage = mySocket.recv( 

) 


30 





Fig. 20.3 Demonstrating the client portion of a stream socket connection between a 
client and a server (part 1 of 2), 
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3T 

32 print "Connection terminat' 

33 mySocket.close() 


Waiting for connection 

Connection 1 received from: 127.0.0.1 


Attempting connection 
Connected to Server 
SERVER>» Connection successful 
CLIENT>» Hi to person at server 


Waiting for connection 
Connection 1 received from: 127.0.0.1 
CLIENT»> Hi to person at server 
SERVER>» Hi back to you—Client! 


Attempting connection 
Connected to Server 
SERVER>» Connection successful 
CLIENT>» Hi to person at server 
SERVER>» Hi back to you—Client! 
CLIENT»> TERMINATE 


Waiting for connection 

Connection 1 received from: 127.0.0.1 

CLIENT»> Hi to person at server 

SERVER>» Hi back to you—Client! 

Connection terminated 

Waiting for connection 


Fig. 20.3 Demonstrating the Client portion of a stream socket connection between a 
Client and a server (part 2 of 2), 

Lines 12-29 perform the work necessary to connect to the server, to receive data from 
the server and to send data to the server. Line 12 creates a socket object— mySocket— 
to establish a connection. Line 15 attempts to connect to the server by calling socket 
method connect with one argument, a two-element tuple. Variable PORT is the same as 
in Fig. 20.2 (5000). This ensures that the client socket attempts to connect to the server 
on the port to which the server is bound. 

If the connection is successful, line 16 prints a message to the screen. The socket 
method recv (line 19) receives a message from the server (i.e., "SERVER>>> Connec¬ 
tion successful"). The while loop (lines 21-29) executes until the client receives 
the message "SERVER>>> TERMINATE". As in the server program, line 23 checks each 
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received message to see if the server has closed the connection. If so, the break statement 
exits the while loop (line 24). 

Each iteration of the loop prints the message received from the server and calls func- 
tion raw_input to read a string from the user. Line 28 sends this string to the server by 
invoking socket method send. The client then receives the next message from the server 
(line 29). When the transmission is complete, line 33 closes the socket instance 
mySocket. 


20.6 Connectionless Client/Server Interaction with Datagrams 

We have been discussing connection-oriented, streams-based transmission. Now we con- 
sider connectionless transmission with datagrams. 

Connection-oriented transmission is like the telephone system in which you dial and 
are given a connection to the telephone you wish to communicate with; the connection is 
maintained for the duration of your phone call, even when you are not talking. 

Connectionless transmission with datagrams is more like the way mail is carried via 
the postal Service. If a large message will not fit in one envelope, you break it into separate 
message pieces that you place in separate, sequentially numbered envelopes. Each of the 
letters is then mailed at once. The letters may arrive in order, out of order or not at all 
(although the last case is rare, it does happen). The person at the receiving end reassembles 
the message pieces into sequential order before attempting to make sense of the message. 
If your message is small enough to fit in one envelope, you do not have to worry about the 
“out-of-sequence” problem, but it is stili possible that your message may not arrive. One 
difference between datagrams and postal mail is that duplicates of datagrams may arrive on 
the receiving computer. 

The programs of Fig. 20.4 and Fig. 20.5 use datagrams to send packets of information 
between a client application and a server applicatiori. In the client application, the user 
types a message and presses Enter. The message is placed in a datagram packet that is sent 
to the server. The server receives the packet and displays the information in the packet, then 
echoes (copies) the packet back to the client. When the client receives the packet, the client 
displays the information in the packet. In this example, the client and server are imple- 
mented similarly. 


1 

# Fig. 20.4: fig20_04.py 


2 

# Set up a server that will receive packets from a 


3 

# client and send packets to a client. 


4 



5 

import socket 


6 



7 

HOST = 


8 

PORT = 


9 



10 

# step 1: create a socket 


11 

mySocket = socket.socket( socket. , socket. 

) 

12 



13 

# step 2: bind the socket 



Fig .20.4 The server side of a connectionless client/server computing with datagrams 
(part 1 of 2), 
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15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 


mySocket.bind( ( HOST, PORT ) ) 

while : 

# step 3: receive packet 

packet, address = mySocket.recvfrom( 

print "Packet received:" 

print , address[ ] 

print , address[ ] 

print , len( packet ) 

print 'Containing : 

print + packet 

# step 4: echo packet back to Client 

print , 

mySocket.sendto( packet, address ) 

print 'Packet sent\n" 

mySocket.close() 


) 



Fig. 20.4 The server side of a connectionless client/server computing with datagrams 
(part 2 of 2). 


The server (Fig. 20.4) defines one socket instance that sends andreceives datagram 
(SOCK_DGRAM) packets. Note that the specified socket type is SOCK_DGRAM. This 
ensures that mySocket will be a datagram socket. Line 14 binds the socket to a port 
(5000) where packets can be received from clients. Clients sending packets to this server 
specify port 5000 in the packets they send. 

The while loop in lines 16-31 receives packets from the client. First, line 19 waits 
for a packet to arrive. The recvfrom method blocks until a packet arrives. Once a packet 
arrives, recvfrom retums a string representing the data received and the address of the 
socket sending the data. The server then prints a message to the screen that contains the 
address of the client and the data sent. 

Line 30 calls socket method sendto to echo the data back to the client. The 
method’ s first argument specifies the data to be sent. The second argument is a tuple that 
specifies the client computer’s Internet address to which the packet will be sent and the port 
where the client is waiting to receive packets. 

The client (Fig. 20.5) works similarly to the server, except that the client sends packets 
only when it is told to do so by the user typing a message and pressing the Enter key. The 
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while loop in lines 13-29 sends packets to the server using sendto (line 18) and waits 
for packets using recvfrom at line 22, which blocks until a packet arrives. 


1 # Fig. 20.5: fig20_05.py 

2 # Set up a Client that will send packets to a 

3 # server and receive packets from a server. 

4 

5 import Socket 

6 

7 HOST = 

8 PORT = 

9 

10 # step 1: create a Socket 

11 mySocket = Socket.Socket( Socket. , Socket. ) 

12 

13 while : 

14 

15 # step 2: send a packet 

16 packet = raw_input( ) 

17 print , packet 

mySocket.sendto( packet, ( HOST, PORT ) ) 

19 print 

20 

21 # step 3: receive packet back from server 

packet, address = mySocket.recvfrom( ) 

23 

24 print 

25 print 

26 print 

27 print 

28 print 

29 print 

30 

31 mySocket.close() 


Packet>»first message packet 

Sending packet containing: first message packet 
Packet sent 

Packet received: 

From host: 127.0.0.1 
Host port: 5000 
Length: 20 
Containing: 

first message packet 

Packet>» 


Fig. 20.5 Demonstrating the Client side of a connectionless client/server computing 
with datagrams . 


, address[ ] 

, address[ ] 

, len( packet ) 

+ packet + 
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20.7 Client/Server Tic-Tac-Toe Using a Multithreaded Server 

In this section, we present our capstone networking example—the popular game Tic-Tac- 
Toe implemented using client/server techniques with stream sockets. The program consists 
of a TicTacToeServer class (Fig. 20.6) that allows two TicTacToeClients 
(Fig. 20.7) to connect to the server and play the game (outputs shown in Fig. 20.7). For each 
client connection, the server creates an instance of class Player (Fig. 20.6) to process the 
client in a separate thread of execution. This enables the clients to play the game indepen- 
dently. The first client to connect is automatically assigned Xs (X makes the first move) 
and the second client to connect is assigned Os. The server maintains the information about 
the game board so it can determine if a requested move by one of the players is valid or 
invalid. Each TicTacToeClient maintains its own GUI version of the Tic-Tac-Toe 
board on which the state of the game is displayed. The clients can only place a mark in an 
empty square on the board. 


1 # Fig. 20.6: fig20_06.py 

2 # Class TicTacToeServer maintains a game of Tic-Tac-Toe 

3 # for two clients, each managed by a Player thread. 

4 

5 import Socket 

6 import threading 

7 

8 class Player ( threading.Thread ): 

9 "Thread used to manage each Tic-Tac-Toe client individually" 

10 

def _ init_( self, connection, server, number ): 

12 "Initialize thread and setup variables" 

13 

threading.Thread._init_( self ) 

15 

16 if number == 

17 self.mark = 

18 else: 

19 self.mark = 

20 

21 self.connection = connection 

self.server = server 

23 self.number = number 

24 

25 def otherPlayerMoved( self, location ): 

26 "Notify Client of opponent's last move” 

27 

28 self.connection.send( ) 

self.connection.send( str( location ) ) 

30 

31 def run( self ): 

32 

33 

34 self.server.display( % self.mark ) 

self.connection.send( self.mark ) 

self.connection.send( % self.mark ) 

Fig. 20.6 Server side of client/server Tic-Tac-Toe program (part 1 of 4). 
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# wait for another player to arrive 

if self.mark == 

self.connection.send( 
self.server.gameBeginEvent.wait() 
self.connection.send( 

else: 

self.server.gameBeginEvent.wait() 
self.connection.send( 

# play game 

while not self.server.gameOver(): 

location = self.connection.recv( ) 

if not location: 

break 

if self.server.validMove( 
self.server.display( 
self.connection.send( 

else : 

self.connection.send( 

self.connection.close() 
self.server.display( ) 

self.server.display( ) 

class TicTacToeServer: 


int( location ), self.number ): 
+ location ) 

) 

) 


# wait for server 
) 


def _ init_( self ) : 


HOST = 

PORT = 

self.board = [] 
self.currentPlayer = 

self.turnCondition = threading.Condition() 
self.gameBeginEvent = threading.Event() 

for i in range( ): 

self.board.append( None ) 

# setup server socket 

self.server = socket.socket( socket. , 

socket. ) 

self.server,bind( ( HOST, PORT ) ) 

self.display( ) 

def execute( self ): 


Fig. 20.6 Server side of client/server Tic-Tac-Toe program (part 2 of 4). 
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144 


self.players = [] 

for i in range( ): 

self.server.listen( ) 

connection, address = self.server.accept() 

self.players.append( Player( connection, self, i ) ) 

self.players[ ].start() 

# players are suspended until player O connects 

# resume players now 

self.gameBeginEvent.set() 

def display( self, message ): 


print message 

def validMove( self, location, player ): 

"Determine if a move is valid—if so, make move" 


# only one move can be made at a time 

self.turnCondition.acquire() 

while player != self.currentPlayer: 
self.turnCondition.wait() 

if not self.isOccupied( location ): 

if self.currentPlayer == 
self.board[ location ] = 

else : 

self.board[ location ] = 

self.currentPlayer = ( self.currentPlayer + ) % 

self.players[ self.currentPlayer ].otherPlayerMoved( 
location ) 

self.turnCondition.notify() 
self.turnCondition.release() 

return 1 
else : 

self.turnCondition.notify() 
self.turnCondition.release() 

return 0 

def isOccupied( self, location ): 


return self.board[ location ] 
def gameOver( self ): 


# place code here testing for a game winner 

# left as an exercise for the reader 


Fig. 20.6 Server side of client/server Tic-Tac-Toe program (part 3 of 4). 
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145 return 

146 

147 def main(): 

148 TicTacToeServer().execute() 

149 

150 if _ name_ == 

151 main() 



We begin with a discussion of the server side of the Tic-Tac-Toe game (Fig. 20.6). 
Line 148 instantiates a TicTacToeServer object and invokes its execute method. 
The TicTacToeServer constructor (lines 68-86) creates data member current- 
Player and condition variable turnCondition. The server uses these members to 
restrict access to method validMove —ensuring that only the current player can make a 
move. Line 77 creates gameBeginEvent —a threading. Event object used to syn- 
chronize the start of the game. Lines 79-80 then initialize the Tic-Tac-Toe board—a list of 
length 9. Note that each location of the board is initialized to None, indicating that the 
space is not yet occupied by either player. Locations are maintained as numbers from 0 to 
8 (0 through 2 for the first row, 3 through 5 for the second row and 6 through 8 for the third 
row). Lines 83-86 prepare the socket on which the server listens for player connections 
and then display a message that the server is now ready. 

Method execute (lines 88-101) loops twice, waiting each time for a connection 
from a client. When the server receives a connection, the server creates a new Player 
instance (lines 8-63) to manage the connection as a separate thread. The Player con¬ 
structor (lines 11-23) takes as arguments the socket instance representing the connection 
to the client, the TicTacToeServer instance and a number indicating what player it is— 
X or O. Line 14 initializes the thread. 

After the server creates each Player (line 96), the server invokes that instance’s 
start method (line 97). The Player’ s run method (lines 31-63) Controls the Informa¬ 
tion that is sent to and received from the client. First, the method passes to the client the 
character that the client places on the board when a move is made, then the method telis the 
client that a connection has been made (lines 35-36). Lines 39-43 then cause player X to 
block until the game can begin (i.e., player O has joined). Lines 44—46 similarly cause 
player O to block until the server begins the game. When both players have joined the 
game, the server starts the game by calling Event method set (line 101). 
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At this point, each Player’s run method executes its while loop (lines 49-59). 
Each iteration of this while loop receives a string representing the location where the 
client wants to place a mark and invokes TicTacToeServer method validMove to 
check the move. Lines 57 and 59 send a message to the client indicating whether or not the 
move was valid. The game continues until TicTacToeServer method garaeOver 
(lines 140-145) indicates that the game is over. Lines 61-63 then close the connection to 
the client and display a message on the server. 

Method validMove (lines 108-133 in class TicTacToeServer) uses condition 
variable methods acquire and release to allow only one move to be attempted at a 
time. This prevents both players from modifying the state information of the game simul- 
taneously. If the Player attempting to validate a move is not the current player (i.e., the 
one allowed to make a move), the Player is placed in a wait state until it is that player’s 
turn to move. If the position for the move being validated is already occupied on the board, 
the method retums 0. Otherwise, the server places a mark for the player in its local repre- 
sentation of the board, updates variable currentPlayer, calls Player method oth- 
erPlayerMoved (lines 25-29) so the client can be notified, invokes the notify 
method so the waiting Player (if there is one) can validate a move and returns 1 to indi¬ 
cate that the move is valid (lines 124-129). 

When a TicTacToeClient (Lig. 20.7) begins execution, it creates a Pmw 
ScrolledText that displays messages from the server and creates a representation of the 
board using nine Tkinter Buttons. Class TicTacToeClient inherits from class 
threading. Thread so that a separate thread can be used to continually read messages 
that are sent from the server to the client. The script’s run method (lines 54-82) opens a 
connection to the server. After the client establishes a connection to the server, the method 
reads the mark character (X or O) from the server (line 65), initializes attribute myTurn to 
0 (line 68) and loops continually to read messages from the server (lines 71-77). The mes¬ 
sages are passed to the script’s processMessage method for processing. When the 
game is over (i.e., the server closes the connection), lines 79-82 close the connection and 
display a message to the user. 


1 # Fig. 20.7: fig20_07.py 

2 # Client for Tic-Tac-Toe program 

3 

4 import Socket 

5 import threading 

6 from Tkinter import * 

7 import Pmw 

8 

9 class TicTacToeClient( Frame, threading.Thread ): 

10 "Client that plays a game of Tic-Tac-Toe" 

11 

12 def _init_( self ): 

13 "Create GUI and play game" 

14 

threading.Thread._init_( self ) 

16 

17 # initialize GUI 

Fig. 20.7 Client side of a client/server Tic-Tac-Toe program (part 1 of 5). 
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Frameinit ( self ) 

Pmw.initialise() 

self.pack( expand = , fili = 

self.master.title( 
self.master.geometry( 


) 


self.id = Label( self, anchor = ) 

self.id.grid( columnspan = , sticky 


+ + + ) 


self.board = [] 


# create and add all buttons to the board 

for i in range( ): 

newButton = Button( self, font = , 

height = , width = , relief = , 

name = str( i ) ) 

newButton.bind( , self.sendClickedSquare ) 

self.board.append( newButton ) 


current = 


# display all buttons in 3x3 grid 

for i in range( , ): 

for j in range( ): 

self.board[ current ].grid( row = i, column = j, 
sticky = + + + ) 

current += 


# area for server messages 

self.display = Pmw.ScrolledText( self, text_height = 
text_width = , vscrollmode = ) 

self.display.grid( row = , columnspan = ) 

self.start() 

def run( self ): 


# setup connection to server 

HOST = 

PORT = 

self.connection = Socket.Socket( Socket. , 

Socket. ) 

self.connection.connect ( ( HOST, PORT ) ) 

# first get player's mark ( X or O ) 

self.myMark = self.connection.recv( ) 

self.id.config( text = % self.myMark ) 

self.myTurn = 

# receive messages sent to Client 
while : 


Fig. 20.7 Client side of a client/server Tic-Tac-Toe program (part 2 of 5). 
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message = self.connection.recv( ) 

if not message: 

break 

self.processMessage( message ) 
self.connection.close() 

self.display.insert( , ) 

self.display.insert( , 

self.display.yview( ) 

def processMessage( self, message ): 


) 


if message == 

self.display.insert( , 

self.display.yview( ) 

self.board[ self.currentSquare ].config( 
text = self.myMark, bg = ) 

elif message == 

self.display.insert( , message + ) 

self.display.yview( ) 

self.myTurn = 
elif message == 

location = int( self.connection.recv( ) ) 


if self.myMark == 

self.board[ location ].config( text = 
bg = ) 

else : 

self.board[ location ].config( text = 
bg = ) 


self.display.insert( 
self.display.yview( 
self.myTurn = 
elif message == 

self.display.insert( 
self.display.yview( 
self.myTurn = 
else : 

self.display.insert( 
self.display.yview( 


, message + 

) 


, message + 

) 


, message + 

) 


) 


) 


def sendClickedSquare( self, event ): 


if self.myTurn: 

name = event.widget.winfo_name() 
self.currentSquare = int( name ) 
self.connection.send( name ) 
self.myTurn = 


) 


Fig. 20.7 Client side of a client/server Tic-Tac-Toe program (part 3 of 5). 
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T2S def main () : 

TicTacToeClient().mainloopO 

128 

129 if _ name_ == 

130 main() 




Tic-Tac-Toe Client 


^JDJ.X| 


You are player 'X" 


X 

[V 










X connected 
Waiting for another player 
Ofher player oonnecfed. Your move. 
Valid move, please wait 


Tic-Tac-Toe Client 


-=JS|x| 


You are player "0" 


X 










0 connected, please wait 
Opponenf moved. Your lurn. 


Fig, 20.7 Client side of a client/server Tic-Tac-Toe program (part 4 of 5). 
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Tic-Tac-Toe Client 


^LBJx| 


You are player 'X" 


X 

0 

X 

X 

0 

0 

X 

X 

0 

Valid move, please wait. 

Opponent moved. Your turn. 

Valid move, please wait. 

Opponent moved. Your turn. 

Valid move, please wait. 

Opponent moved. Your turn. 

Valid move, please wait. 

Opponent moved. Your turn. 

Valid move, please wait. 




Fig. 20.7 Client side of a client/server Tic-Tac-Toe program (part 5 of 5). 

Method processMessage (lines 84-115) interprets server messages. If the mes- 
sage received is the string "Valid move . ", the client displays the message "Valid 
move, please wait . ", sets its mark in the square that the user clicked (indicated by 
attribute currentSquare) and colors the square white. If the client receives the message 
"Invalid move, try again . ", the client displays the message and sets attribute 
myTurn to 1 so the user can click a different square. If the client receives the message 
" Opponent moved . ", the client receives an integer from the server indicating where the 
opponent moved. The client then places the opponent’s mark in that square of the board, 
colors the square gray, displays a message and sets myTurn to 1. If the client receives the 
message "Other player connected. Your move . ", the client displays the mes¬ 
sage and sets myTurn to 1. Note that this message is sent to player X only when player O 
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initially connects (lines 42-43). If the client receives any other message, the client simply 
displays the message. 

When the player clicks a space on the board (a Tkinter Button), method send- 
ClickedSquare is invoked. Method sendClickedSquare (lines 117-124) first 
tests whether it is the player’s tum. If so, line 121 obtains the name of the button pressed 
by invoking Widget method winf o_name and Stores the value in variable name. Lines 
122-124 then update attribute currentSquare, send the move to the server and set 
attribute myTurn to 0, so that the player cannot make another move until it has received 
feedback from the server. 
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Notes to Reviewers: 


• Please mark your comments in place on a paper copy of the chapter. 

• Please retum only marked pages to Deitel & Associates, Inc. 

• Please do not send e-mails with detailed, line-by-line comments; mark these directly on the paper 
pages. 

• Please feel free to send any lengthy additional comments by e-mail to 

ben. wiedermann@dei.tel .net. 

• Please run ali the code examples. 

• Please check that we are using the correct programming idioms. 

• Please check that there are no inconsistencies, errors or omissions in the chapter discussions. 

• The manuscript is being copy edited by a professional copy editor in parallel with your reviews. 
That person will probably find most typos, spelling errors, grammatical errors, etc. 

• Please do not rewrite the manuscript. We are mostly concerned with technical correctness and cor¬ 
rect use of idiom. We will not make significant adjustments to our writing or coding style on a 
global scale. Please send us a short e-mail if you would like to make a suggestion. 

• If you find something incorrect, please show us how to correct it. 

• In the later round(s) of review, please read all the back matter, including the exercises and any So¬ 
lutions we provide. 

• Please review the index we provide with each chapter to be sure we have covered the topics you 
feel are important. 
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Objectives 

• To understand the basic concepts of security. 

• To understand public-key/private-key cryptography. 

• To learn about popular security protocols, such as 
SSL. 

• To understand digital signatures, digital certificates, 
certificate authorities and public-key infrastructure. 

• To understand Python programming security issues. 

• To learn to write restricted Python code. 

• To become aware of various threats to secure systems. 
Three may keep a secret, iftwo ofthem are dead. 

Benjamin Franklin 

Attack — Repeat — Attack. 

William Frederick Halsey, Jr. 

Private information is practically the source ofeveiy large 
modern fortune. 

Oscar Wilde 

There must he security for ali—or not one is safe. 

The Day the Earth Stood Stili, screenplay by Edmund H. 
North 

No government can be long secure without formidable 
oppositiori. 

Benjamin Disraeli 



Under 

Constructi on 
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21.1 Introduction 


The explosion of e-business is forcing companies and consumers to focus on Internet and 
network security. Consumers are buying products, trading stocks and banking Online. They 
are submitting their credit-card numbers, social-security numbers and other confidential in- 
formation to vendors through Web sites. Businesses are sending confidential information 
to clients and vendors using the Internet. At the same time, an increasing number of security 
attacks are taking place on e-businesses, and companies and customers are vulnerable to 
these attacks. Data theft and hacker attacks can corrupt files and even shut down businesses. 
Preventing or protecting against such attacks is crucial to the success of e-business. In this 
chapter, we explore Internet security, including securing electronic transactions and net- 
works. We discuss how a Python programmer can secure programming code. We also ex¬ 
amine the fundamentals of secure business and how to secure e-commerce transactions 
using current technologies. 


e-Fact 21.1 



According to a study by International Data Corporation (IDC), organizations spent $6.2 bil- 
lion on security Consulting in 1999, and IDC expects the market to reach $14.8 billion by 


2003. 


Modern computer security addresses the problems and concerns of protecting elec¬ 
tronic Communications and maintaining network security. There are four fundamental 
requirements for a successful, secure transactioni privacy, integrity, authentication and 
non-repudiation. The privacy issue is: How do you ensure that the information you transmit 
over the Internet has not been captured or passed on to a third party without your knowl- 
edge? The integrity issue is: How do you ensure that the information you send or receive 
has not been compromised or altered? The authentication issue is: How do the sender and 
receiver of a message prove their identities to each other? The nonrepudiation issue is: How 
do you legally prove that a message was sent or received? 

In addition to these requirements, network security addresses the issue of availability: 
How do we ensure that the network and the computer systems to which it connects will stay 
in continuous operation? 

Python applications potentially can access files on the local computer on which the 
code is run. This chapter explains how a programmer can write secure, restricted environ- 
ment Python code. 


e-Fact 21.2 



According to Forrester Research, it is predicted that organizations will spend 55% more on 


security in 2002 than they spent in 2000? 


We encourage you to visit the Web resources provided in Section 21.16 to learn more 
about the latest developments in e-business security. These resources include many infor- 
mative and entertaining demos. 


21.2 Ancient Ciphers to Modern Cryptosystems 


The channels through which data passes are inherently unsecure; therefore, any private in¬ 
formation passed through these channels must somehow be protected. To secure informa¬ 
tion, data can be encrypted. Cryptography transforms data by using a cipher, or 
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cryptosystem —a mathematical algorithm for encrypting messages (algorithm is a computer 
Science term for “procedure”). A key —a string of digits that acts as a password—is input 
to the cipher. The cipher uses the key to make data incomprehensible to ali but the sender 
and intended receivers. Unencrypted data is called plaintext, encrypted data is called ci- 
phertext. The algorithm is responsible for encrypting data, while the key acts as a vari- 
able—using different keys results in different ciphertext. Only the intended receivers 
should have the corresponding key to decrypt the ciphertext into plaintext. 

Cryptographic ciphers have been used throughout history, first recorded by the ancient 
Egyptians, to conceal and protect valuable information. In ancient cryptography, messages 
were encrypted by hand, usually with a method based on the alphabetic letters of the mes- 
sage. The two main types of ciphers were substitution ciphers and transposition ciphers. In 
a substitution cipher, every occurrence of a given letter is replaced by a different letter; for 
example, if every “a” is replaced by a “b,” every “b” by a “c,” etc., the word “security” 
would encrypt to “tfdvsjuz.” The first prominent substitution cipher was credited to lulius 
Caesar, and is referred to today as the Caesar Cipher. Using the Caesar Cipher, every 
instance of a letter is encrypted by replacing by the letter in the alphabet three places to the 
right. For example, using the Caesar Cipher, the word “security” would encrypt to “vhfx- 
ulwb.” 

In a transposition cipher, the ordering of the letters is shifted; for example, if every 
other letter, starting with “s,” in the word “security” creates the first word in the ciphertext 
and the remaining letters create the second word in the ciphertext, the word “security” 
would encrypt to “scrt euiy.” Complicated ciphers combine substitution and transposition 
ciphers. For example, using the substitution cipher first, followed by the transposition 
cipher, the word “security” would encrypt to “tdsu fvjz.” The problem with many historical 
ciphers is that their security relied on the sender and receiver to remember the encryption 
algorithm and keep it secret. Such algorithms are called restricted algorithms. Restricted 
algorithms are not feasible to implement among a large group of people. Imagine if the 
security of U.S. government Communications relied on every U.S. government employee 
to keep a secret; the encryption algorithm could easily be compromised. 

Modern cryptosystems are digital. Their algorithms are based on the individual bits or 
blocks (a group of bits) of a message, rather than letters of the alphabet. A computer Stores 
data as a binary string, which is a sequence of ones and zeros. Each digit in the sequence 
is called a bit. Encryption and decryption keys are binary strings with a given key length. 
For example, 128-bit encryption systems have a key length of 128 bits. Longer keys have 
stronger encryption; it takes more time and computing power to crack the message. 

Until January 2000, the U.S. government placed restrictions on the strength of crypto¬ 
systems that could be exported from the United States by limiting the key length of the 
encryption algorithms. Today, the regulations on exporting products that employ cryptog¬ 
raphy are less stringent. Any cryptography product may be exported as long as the end user 
is not a foreign government or from a country with embargo restrictions on it. 3 

21.3 Secret-key Cryptography 

In the past, organizations wishing to maintain a secure computing environment used sym- 
metric cryptography, also known as secret-key cryptography. Secret-key cryptography 
uses the same secret key to encrypt and decrypt a message (Fig. 21.1). In this case, the send- 
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er encrypts a message using the secret key, then sends the encrypted message to the intend- 
ed recipient. A fundamental problem with secret-key cryptography is that before two 
people can communicate securely, they must find a secure way to exchange the secret key. 
One approach is to have the key delivered by a courier, such as a mail Service or FedEx. 
While this approach may be feasible when two individuals communicate, it is not efficient 
for securing communication in a large network, nor can it be considered completely secure. 
The privacy and the integrity of the message would be compromised if the key is intercept- 
ed as it is passed between the sender and the receiver over unsecure channels. Also, since 
both parties in the transaction use the same key to encrypt and decrypt a message, one can- 
not authenticate which party created the message. Finally, to keep Communications private 
with each receiver, a sender needs a different secret key for each receiver. As a resuit, or- 
ganizations would have huge numbers of secret keys to maintain. 



Sender 


Communications 




Same 
symmetric 
secret key 

BuylOOshares decrypt 
of company X — - 


Receiver Plaintext 


Fig. 21.1 Encrypting and decrypting a message using a secret key, 

An alternative approach to the key-exchange problem is to have a Central authority, 
called a key distributiori center ( KDC ). The key distribution center shares a (different) 
secret key with every user in the network. In this system, the key distribution center gener- 
ates a session key to be used for a transaction (Fig. 21.2). Next, the key distribution center 
distributes the session key to the sender and receiver, encrypted with the secret key they 
each share with the key distribution center. For example, say a merchant and a customer 
want to conduct a secure transaction. The merchant and the customer each have unique 
secret keys that they share with the key distribution center. The key distribution center gen- 
erates a session key for the merchant and customer to use in the transaction. The key dis¬ 
tribution center then sends the session key for the transaction to the merchant, encrypted 
using the secret key the merchant already shares with the center. The key distribution center 
sends the same session key for the transaction to the customer, encrypted using the secret 
key the customer already shares with the key distribution center. Once the merchant and the 
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customer have the session key for the transaction they can communicate with each other, 
encrypting their messages using the shared session key. 


© 



"I want to communicate 
with the receiver" 


Sender 


Key distribution 
center (KDC) 



Receiver 


ii 


ii 



Session key 

encrypted with ^ ^pftcrypt 
the sender's 
KDC Key 



Session key 
(symmetric 
secret key) 


encrypt 



Session key 
encrypted with 
the receiver's 
KDC key 


Fig. 21.2 Distributing a session key with a key distribution center. 

Using a key distribution center reduces the number of courier deliveries (again, by 
means such as mail or FedEx) of secret keys to each user in the network. In addition, users 
can have a new secret key for each communication with other users in the network, which 
greatly increases the overall security of the network. However, if the security of the key dis¬ 
tribution center is compromised, then the security of the entire network is compromised. 

One of the most commonly used symmetric encryption algorithms is the Data Encryp- 
tion Standard (DES). Horst Feistel of IBM created the Lucifer algorithm, which was chosen 
as the DES by the United States government and the National Security Agency (NSA) in 
the 1970s. 4 DES has a key length of 56 bits and encrypts data in 64-bit blocks. This type of 
encryption is known as a block cipher. A block cipher is an encryption method that creates 
groups of bits from an original message, then applies an encryption algorithm to the block 
as a whole, rather than as individual bits. This method reduces the amount of computer Pro¬ 
cessing power and time required, while maintaining a fair level of security. For many years, 
DES was the encryption Standard set by the U.S. government and the American National 
Standards Institute (ANSI). However, due to advances in technology and computing speed, 
DES is no longer considered secure. In the late 1990s, specialized DES cracker machines 
were built that recovered DES keys after just several hours. 5 As a resuit, the old Standard 
of symmetric encryption has been replaced by Triple DES, or 3DES, a variant of DES that 
is essentially three DES systems in a row, each with its own secret key. Though 3DES is 
more secure, the three passes through the DES algorithm resuit in slower performance. The 
United States government recently selected a new, more secure Standard for symmetric 
encryption to replace DES. The new Standard is called the Advanced Encryption Standard 
(AES). The National Institute of Standards and Technology (NIST), which sets the crypto- 
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graphic standards for the U.S. government, is evaluating Rijndael as the encryption method 
for AES. Rijndael is a block cipher developed by Dr. Joan Daemen and Dr. Vincent Rijmen 
of Belgium. Rijndael can be used with key sizes and block sizes of 128, 192 or 256 bits. 
Rijndael was chosen over four other finalists as the AES candidate because of its high secu¬ 
rity, performance, efficiency, flexibility and low memory requirement for computing Sys¬ 
tems. 6 For more information about AES, visit csrc.nist.gov/encryption/aes. 

21.4 Public-key Cryptography 

In 1976, Whitfield Diffie and Martin Hellman, researchers at Stanford University, devel¬ 
oped public-key cryptography to solve the problem of exchanging keys securely. Public- 
key cryptography is asymmetric. It uses two inversely related keys: a public key and a pri¬ 
vate key. The private key is kept secret by its owner, while the public key is freely distrib- 
uted. If the public key is used to encrypt a message, only the corresponding private key can 
decrypt it, and vice versa (Fig. 21.3). Each party in a transaction has both a public key and 
a private key. To transmit a message securely, the sender uses the receiver’s public key to 
encrypt the message. The receiver then decrypts the message using his or her unique private 
key. Assuming that the private key has been kept secret, the message cannot be read by any- 
one other than the intended receiver. Thus the system ensures the privacy of the message. 
The defining property of a secure public-key algorithm is that it is “computationally infea- 
sible” to deduce the private key from the public key. Although the two keys are mathemat- 
ically related, deriving one from the other would take enormous amounts of computing 
power and time, enough to discourage attempts to deduce the private key. An outside party 
cannot participate in communication without the correct keys. The security of the entire 
process is based on the secrecy of the private keys. Therefore, if a third party obtains the 
private key used in decryption, the security of the whole system is compromised. If a sys¬ 
tem’s integrity is compromised, the user can simply change the key, instead of changing 
the entire encryption or decryption algorithm. 



Sender 


Communications 



Receiver's 
private key 


Buy 100 shares 
of company X 


decrypt 


Receiver Plaintext 


Fig. 21.3 Encrypting and decrypting a message using public-key cryptography. 
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Either the public key or the private key can be used to encrypt or decrypt a message. 
For example, if a customer uses a merchant’s public key to encrypt a message, only the 
merchant can decrypt the message, using the merchant’s private key. Thus, the merchant’s 
identity can be authenticated, since only the merchant knows the private key. However, the 
merchant has no way of validating the customer’s identity, since the encryption key the cus¬ 
tomer used is publicly available. 

If the decryption key is the sender’s public key and the encryption key is the sender’s 
private key, the sender of the message can be authenticated. For example, suppose a cus¬ 
tomer sends a merchant a message encrypted using the customer’s private key. The mer¬ 
chant decrypts the message using the customer’s public key. Since the customer encrypted 
the message using his or her private key, the merchant can be confident of the customer’s 
identity. This process authenticates the sender, but does not ensure confidentiality, as 
anyone could decrypt the message with the sender’s public key. This systems works as long 
as the merchant can be sure that the public key with which the merchant decrypted the mes¬ 
sage belongs to the customer, and not a third party posing as the customer. 

These two methods of public-key encryption can actually be used together to authen- 
ticate both participants in a communication (Fig. 21.4). Suppose a merchant wants to send 
a message securely to a customer so that only the customer can read it, and suppose also 
that the merchant wants to provide proof to the customer that the merchant (not an unknown 
third party) actually sent the message. First, the merchant encrypts the message using the 
customer's public key. This step guarantees that only the customer can read the message. 
Then the merchant encrypts the resuit using the merchant’s private key, which proves the 
identity of the merchant. The customer decrypts the message in reverse order. First, the cus¬ 
tomer uses the merchant’s public key. Since only the merchant could have encrypted the 
message with the inversely related private key, this step authenticates the merchant. Then 
the customer uses the customer’s private key to decrypt the next level of encryption. This 
step ensures that the content of the message was kept private in the transmission, since only 
the customer has the key to decrypt the message. Although this system provides extremely 
secure transactions, the setup cost and time required prevent widespread use. 
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Sender 



Buy 100 shares 
of company X 


Receiver 


Plaintext 



/ decrypt 




Receiver's 
private key 


XY%#? 

42%Y 

Ciphertext 


1 decrypt 


Sender's public key 
(authenticates 
sender) 


Fig. 21.4 Authentication with a public-key algorithm 

The most commonly used public-key algorithm is RSA, an encryption system devel- 
oped in 1977 by MIT professors Ron Rivest, Adi Shamir and Leonard Adleman. 7 Today, 
most Fortune 1000 companies and leading e-commerce businesses use their encryption and 
authentication technologies. With the emergence of the Internet and the World Wide Web, 
their security work has become even more significant and plays a crucial role in e-com- 
merce transactions. Their encryption products are built into hundreds of millions of copies 
of the most popular Internet applications, including Web browsers, commerce servers and 
e-mail systems. Most secure e-commerce transactions and Communications on the Internet 
use RSA products. For more information about RSA, cryptography and security, visit 
www.rsasecurity.com. 

Pretty Good Privacy (PGP) is a public-key encryption system used for the encryption 
of e-mail messages and files. PGP was designed in 1991 by Phillip Zimmermann. 8 PGP can 
also be used to provide digital signatures (see Section 21.8, Digital Signatures) that confirm 
the author of an e-mail or public posting. PGP is based on a “web of trust;” each client in a 
network can vouch for another client’s identity to prove ownership of a public key. The 
“web of trust” is used to authenticate each client. If users know the identity of a public key 
holder, through personal contact or another secure method, they validate the key by signing 
it with their own key. The web grows as more users validate the keys of others. To learn 
more about PGP and to download a free copy of the Software, go to the MIT Distribution 
Center for PGP at web.mit. edu/network/pgp.html. 


© Copyright 1992-2002 by Deitel & Associates, Inc. AII Rights Reserved. 8/29/01 





















































pythonhtpl_21.fm Page 786 Wednesday, August 29, 2001 4:16 PM 


786 Security Chapter21 

21.5 Cryptanalysis 

Even if keys are kept secret, it may be possible to compromise the security of a system. Try- 
ing to decrypt ciphertext without knowledge of the decryption key is known as cryptanal¬ 
ysis. Commercial encryption systems are constantly being researched by cryptologists to 
ensure that the systems are not vulnerable to a cryptanalytic attack. The most common form 
of cryptanalytic attacks are those in which the encryption algorithm is analyzed to find re- 
lations between bits of the encryption key and bits of the ciphertext. Often, these relations 
are only statistical in nature and incorporate an analyzer’s outside knowledge about the 
plaintext. The goal of such an attack is to determine the key from the ciphertext. 

Weak statistical trends between ciphertext and keys can be exploited to gain knowl¬ 
edge about the key if enough ciphertext is known. Proper key management and expiration 
dates on keys help prevent cryptanalytic attacks. When a key is used for long periods of 
time, more ciphertext is generated that can be beneficial to an attacker trying to derive a 
key. If a key is unknowingly recovered by an attacker, it can be used to decrypt every mes- 
sage for the life of that key. Using public-key cryptography to exchange secret keys 
securely allows a new secret key to encrypt every message. 

21.6 Key Agreement Protocols 

A drawback of public-key algorithms is that they are not efficient for sending large amounts 
of data. They require significant computer power, which slows down communication. Pub¬ 
lic-key algorithms should not be thought of as a replacement for secret-key algorithms. In- 
stead, public-key algorithms allow two parties to agree on a key to be used for secret-key 
encryption over an unsecure medium. The process by which two parties can exchange keys 
over an unsecure medium is called a key agreement protocol. A protocol sets the rules for 
communication: Exactly what encryption algorithm(s) is (are) going to be used? 

The most common key agreement protocol is a digital envelope (Fig. 21.5). With a dig- 
ital envelope, the message is encrypted using a secret key (Step 1), and the secret key is 
encrypted using public-key encryption (Step 2). The sender attaches the encrypted secret 
key to the encrypted message and sends the receiver the entire package. The sender could 
also digitally sign the package before sending it to prove the sender’s identity to the 
receiver (Section 23.8). To decrypt the package, the receiver first decrypts the secret key 
using the receiver’s private key. Then, the receiver uses the secret key to decrypt the actual 
message. Since only the receiver can decrypt the encrypted secret key, the sender can be 
sure that only the intended receiver is reading the message. 
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Fig. 21.5 Creating a digital envelope. 

21.7 Key Management 

Maintaining the secrecy of private keys is crucial to keeping cryptographic systems secure. 
Most compromises in security resuit from poor key management (e.g., the mishandling of 
private keys, resulting in key theft) rather than attacks that attempt to guess the keys. 9 

A main component of key management is key generation —the process by which keys 
are created. A malicious third party could try to decrypt a message by using every possible 
decryption key, a process known as brute-force cracking. Key-generation algorithms are 
sometimes unintentionally constructed to choose from only a small subset of possible keys. 
If the subset is too small, then the encrypted data is more susceptible to brute-force attacks. 
Therefore, it is important to have a key-generation program that can generate a large 
number of keys as randomly as possible. Keys are made more secure by choosing a key 
length so large that it is computationally infeasible to try all combinations. 

21.8 Digital Signatures 

Digital signatures, the electronic equivalent of written signatures, were developed to be 
used in public-key cryptography to solve the problems of authentication and integrity (see 
Microsoft Authenticode feature). A digital signature authenticates the sender’s identity, 
and, like a written signature, it is difficult to forge. 
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To create a digital signature, a sender first takes the original plaintext message and runs 
it through a hash function, which is a mathematical calculation that gives the message a 
hash value. A one-way hashing function generates a string of characters that is unique to 
the input file. The Secure Hash Algorithm (SHA-1) is the current Standard for hashing func- 
tions. In using SHA-1, the phrase “Buy 100 shares of company X” would produce the hash 
value D8 A9 B6 9F 72 65 OB D5 6D 0C 47 00 95 0D FD 31 96 0A FD B5. MD5 is another 
popular hash function, which was developed by Ronald Rivest to verify data integrity 
through a 128-bit hash value of the input file. 10 [***<userpages .umbc .edu/ 
~mabzugl/cs/md5/md5 .html>***] The following interactive session demonstrates 
the ways to get the MD5 hash of the same phrase in Python. 


Python 2.1 (#15, Apr 16 2001, 18:25:49) [MSC 32 bit (Intel)] on 
win32 

Type "Copyright", "credits" or "license" for more information. 
>>> import md5 

>>> ml = md5.new( "Buy 100 shares of company X" ) 

>>> print ml.hexdigest() 
del746f8b9f91decab749e5fa3955af7 
>>> m2 = md5.new() 

>>> m2.update( "Buy 100 shares " ) 

>>> print m2.hexdigest() 
leaa9fd4f62aala88d64d2d69b7d4f13 
>>> m2.update( "of company X" ) 

>>> print m2.hexdigest() 
del746f8b9f91decab749e5fa3955af7 
>>> 


Examples of SHA-1 and MD5 are available at home.istar.ca/~neutron/ 
messagedigest. At this site, users can input text or files into a program to generate the 
hash value. The hash value is also known as a message digest. The chance that two different 
messages will have the same message digest is statistically insignificant. Collision occurs 
when multiple messages have the same hash value. It is computationally infeasible to com- 
pute a message from its hash value or to find two messages with the same hash value. 

Next, the sender uses the sender’s private key to encrypt the message digest. This step 
creates a digital signature and authenticates the sender, since only the owner of that private 
key could encrypt the message. A message that includes the digital signature, hash function 
and original message (encrypted using the receiver’s public key) is sent to the receiver. The 
receiver uses the sender’s public key to decipher the original digital signature and reveal 
the message digest. The receiver then uses his or her own private key to decipher the orig¬ 
inal message. Finally, the receiver applies the hash function to the original message. If the 
hash value of the original message matches the message digest included in the signature, 
there is message integrity, the message has not been altered in transmission. 

There is a fundamental difference between digital signatures and handwritten signa- 
tures. A handwritten signature is independent of the document being signed. Thus, if 
someone can forge a handwritten signature, they can use that signature to forge multiple 
documents. A digital signature is created using the contents of the document. Therefore, 
your digital signature is different for each document you sign. 
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Digital signatures do not provide proof that a message has been sent. Consider the fol- 
lowing situation: A contractor sends a company a digitally signed contract, which the con¬ 
tractor later would like to revoke. The contractor could do so by releasing the private key 
and then claiming that the digitally signed contract came from an intruder who stole the 
contractor’s private key. Timestamping, which binds a time and date to a digital document, 
can help solve the problem of non-repudiation. For example, suppose the company and the 
contractor are negotiating a contract. The company requires the contractor to sign the con¬ 
tract digitally and then have the document digitally timestamped by a third party called a 
timestamping agency. The contractor sends the digitally-signed contract to the time¬ 
stamping agency. The privacy of the message is maintained since the timestamping agency 
sees only the encrypted, digitally-signed message (as opposed to the original plaintext mes¬ 
sage). The timestamping agency affixes the time and date of receipt to the encrypted, signed 
message and digitally signs the whole package with the timestamping agency’s private key. 
The timestamp cannot be altered by anyone except the timestamping agency, since no one 
else possesses the timestamping agency's private key. Unless the contractor reports the pri¬ 
vate key to have been compromised before the document was timestamped, the contractor 
cannot legally prove that the document was signed by an unauthorized third party. The 
sender could also require the receiver to sign the message digitally and timestamp it as 
proof of receipt. To learn more about timestamping, visit AuthentiDate. com. 

The U.S. government’s digital-authentication Standard is called the Digital Signature 
Algorithm (DSA ). The U.S. government recently passed digital-signature legislation that 
makes digital signatures as legally binding as handwritten signatures. This legislation is 
expected to increase e-business dramatically. For the latest news about U.S. government 
legislation in information security, visit www. itaa.org/infosec. For more Informa¬ 
tion about the bilis, visit the following government sites: 

thomas.loc.gov/cgi-bin/bdquery/z?dl06:hr.01714: 
thomas.loc.gov/cgi-bin/bdquery/z?dl06:s.00761: 

21.9 Public-key Infrastructure, Certificates and Certificate 
Authorities 

One problem with public-key cryptography is that anyone with a set of keys could poten- 
tially assume another party’s identity. For example, say a customer wants to place an order 
with an Online merchant. FIow does the customer know that the Web site indeed belongs to 
that merchant and not to a third party that posted a site and is masquerading as a merchant 
to steal credit-card information? Public Key Infrastructure (PKI ) provides a solution to 
these problems. PKI integrates public-key cryptography with digital certificates and certif¬ 
icate authorities to authenticate parties in a transaction. 
e-Fact 21.3 

The Aberdeen Group predicts that approximately 98% ofall Global 2000 companies will im- 
plement PKI Solutions by 2003 . 11 

A digital certificate is a digital document used to identify a user and issued by a certif¬ 
icate authority (CA). A digital certificate includes the name of the subject (the company or 
individual being certified), the subject’s public key, a serial number, an expiration date, the 
signature of the trusted certificate authority and any other relevant information (Fig. 21.6). 
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A CA is a financial institution or other trusted third party, such as VeriSign. Once issued, 
the digital certificates are publicly available and are held by the certificate authority in cer- 
tificate repositories. 



Fig. 21.6 Porlion of a VeriSign digital certificate. (Courtesy of VeriSign, Inc.) 

The CA signs the certificate by encrypting either the subject’s public key or a hash 
value of the public key using the CA’s own private key. The CA has to verify every sub¬ 
jecti public key. Thus, users must trust the public key of a CA. Usually, each CA is part 
of a certificate authority hierarchy. This hierarchy is similar to a chain of trust in which 
each link relies on another link to provide authentication information. A certificate 
authority hierarchy is a chain of certificate authorities, starting with the root certificate 
authority, which is the Internet Policy Registration Authority (IPRA). The IPRA signs cer¬ 
tificates using the root key. The root key signs certificates only for policy creation author¬ 
ities, which are organizations that set policies for obtaining digital certificates. In turn, 
policy creation authorities sign digital certificates for CAs. CAs then sign digital certifi¬ 
cates for individuals and organizations. The CA takes responsibility for authentication, so 
it must check information carefully before issuing a digital certificate. In one case, human 
error caused VeriSign to issue two digital certificates to an imposter posing as a Microsoft 
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employee. 12 Such an error is significant; the inappropriately issued certificates can cause 
users to download malicious code unknowingly onto their machines (see Authentication: 
Microsoft Authenticode feature). 

VeriSign, Inc., is a leading certificate authority. For more information about VeriSign, 
visit www.verisign.com. For a listing of other digital-certificate vendors, please see 
Section 21.16. 

^ e-Fact 21.4 _ 

It can take a year and costfrom $5 million to $10 millionfor a financial. firm to build a digital 
certificate infrastructure, according to Identrus, a consortium of global financial companies 
that is providing a framework for trustecl business-to-business e-commerce . 13 

Periodically changing key pairs is necessary in maintaining a secure system, as a pri¬ 
vate key may be compromised without a user’s knowledge. The longer a key pair is used, 
the more vulnerable the keys are to attack and cryptanalysis. As a resuit, digital certificates 
are created with an expiration date, to force users to switch key pairs. If a private key is 
compromised before its expiration date, the digital certificate can be canceled, and the user 
can get a new key pair and digital certificate. Canceled and revoked certificates are placed 
on a certificate revocation list ( CRL). CRLs are stored with the certificate authority that 
issued the certificates. It is essential for users to report immediately if they suspect that their 
private keys have been compromised, as the issue of non-repudiation makes certificate 
owners responsible for anything appearing with their digital signatures. In States with laws 
on digital signatures, certificates legally bind certificate owners to any transactions 
involving their certificates. 

CRLs are similar to old paper lists of revoked credit-card numbers that were used at 
the points of sale in Stores. 14 This makes for a great inconvenience when checking the 
validity of a certificate. An alternative to CRLs is the Online Certificate Status Protocol 
( OCSP ), which validates certificates in real-time. OCSP technology is currently under 
development. For an overview of OCSP, read “X.509 Internet Public Key Infrastructure 
Online Certificate Status Protocol—OCSP” located at ftp.isi.edu/in-notes/ 
rfc2560.txt. 

Many people stili consider e-commerce unsecure. However, transactions using PKI 
and digital certificates can be more secure than exchanging private information over phone 
lines, through the mail or even than paying by credit card in person. After all, when you go 
to a restaurant and the waiter takes your credit card in back to process your bili, how do you 
know the waiter did not write down your credit-card information? In contrast, the key algo- 
rithms used in most secure Online transactions are nearly impossible to compromise. By 
some estimates, the key algorithms used in public-key cryptography are so secure that even 
millions of today’s computers working in parallel could not break the codes in a century. 
However, as computing power increases, key algorithms considered strong today could be 
broken in the future. 

Digital-certificate capabilities are built into many e-mail packages. For example, in 
Microsoft Outlook, you can go to the Tools menu and select Options. Then click on the 
Security tab. At the bottom of the dialog box, you will see the option to obtain a digital 
ID. Selecting the option will take you to a Microsoft Web site with links to several world- 
wide certificate authorities. Once you have a digital certificate, you can sign your e-mail 
messages digitally. 
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To obtain a digital certificate for your personal e-mail messages, visit www.veri- 
sign.com or www.thawte.com. VeriSign offers a free 60-day trial, or you can pur- 
chase the Service for a yearly fee. Thawte offers free digital certificates for personal e-mail. 
Web server certificates may also be purchased through VeriSign and Thawte; however, 
they are more expensive than e-mail certificates. 


Authentication: Microsoft Authenticode 

How do you know that the Software you ordered Online is safe and has not been altered? 
How can you be sure that you are not downloading a computer virus that could wipe 
out your computer? Do you trust the source of the Software? With the emergence of e- 
commerce, Software companies are offering their products Online, so that customers 
can download Software directly onto their computers. Security technology is used to 
ensure that the downloaded Software is trustworthy and has not been altered. Microsoft 
Authenticode, combined with VeriSign digital certificates (or digital IDs), authenti- 
cates the publisher of the Software and detects whether the Software has been altered. 
Authenticode is a security feature built into Microsoft Internet Explorer. 

To use Microsoft Authenticode technology, each Software publisher must obtain a 
digital certificate specifically designed for the purpose of publishing Software; such 
certificates may be obtained through certificate authorities, such as VeriSign (Section 
6.9). To obtain a certificate, a Software publisher must provide its public key and iden- 
tification information and sign an agreement that it will not distribute harmful Software. 
This requirement gives customers legal recourse if any downloaded Software from cer- 
tified publishers causes harm. 

Microsoft Authenticode uses digital-signature technology to sign Software (Sec¬ 
tion 6.8). The signed Software and the publisher’s digital certificate provide proof that 
the Software is safe and has not been altered. 

When a customer attempts to download a file, a dialog box appears on the screen 
displaying the digital certificate and the name of the certificate authority. Links to the 
publisher and the certificate authority are provided so that customers can learn more 
about each party before they agree to download the Software. If Microsoft Authenti¬ 
code determines that the Software has been compromised, the transaction is terminated. 

To learn more about Microsoft Authenticode, visit the following sites: 
msdn.microsoft.com/workshop/security/authcode/signfaq.asp 
msdn.microsoft.com/workshop/security/authcode/authwp.asp 


21.9.1 Smart Cards 

One of the fastest growing applications of PKI is the smart card. A smart card generally 
looks like a credit card and can serve many different functions, from authentication to data 
storage. The most popular smart cards are memory cards and microprocessor cards. Mem¬ 
ory cards are similar to floppy disks. Microprocessor cards are similar to small computers, 
with operating systems, security and storage. Smart cards also have different interfaces 
with which they internet with reading devices. One type of interface is a contact interface, 
in which smart cards are inserted into a reading device and physical contact between the 
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device and the card is necessary. The alternative to this method is a contactless interface, 
in which data is transferred to a reader via an embedded wireless device in the card, without 
the card and the device having to make physical contact. 15 

Smart cards store private keys, digital certificates and other information necessary for 
implementing PKI. They may also store credit card numbers, personal contact information, 
etc. Each smart card is used in combination with a personal Identification number (PIN). 
This application provides two levels of security by requiring the user to both possess a 
smart card and know the corresponding PIN to access the information stored on the card. 
As an added measure of security, some microprocessor cards will delete or corrupt stored 
data if malicious attempts at tampering with the card occur. Smart card PKI is stored por- 
table, allowing users to access information from multiple devices using the same smart 
card. 

r e-Fact 21.5 _ 

According to Dataquest, use of smart cards is growing 30% peryear, and it is expected that 
3.4 billion smarts cards will be in used worldwide in 2001. 16 

21.10 Security Protocols 

Everyone using the Web for e-business and e-commerce needs to be concerned about the 
security of their personal information. In this section, we discuss network security proto¬ 
cols, such as Internet Protocol Security (IPSec), and transport layer security protocols such 
as Secure Sockets Layer (SSL). NetWork security protocols protect Communications be- 
tween networks; transport layer security protocols are used to establish secure connections 
for data to pass through. 

21.10.1 Secure Sockets Layer (SSL) 

Currently, most e-businesses use SSL for secure Online transactions, although SSL is not 
designed specifically for securing transactions. Rather, SSL secures World Wide Web con¬ 
nections. The Secure Sockets Layer (SSL) protocol, developed by Netscape Communica¬ 
tions, is a non-proprietary protocol commonly used to secure communication between two 
computers on the Internet and the Web. SSL is built into many Web browsers, including 
Netscape Communicator and Microsoft Internet Explorer, as well as numerous other Soft¬ 
ware products. It operates between the Internet’s TCP/IP Communications protocol and the 
1 8 

application Software. 

In a Standard correspondence over the Internet, a sender’s message is passed to a 
socket, which receives and transmits information from a network. The Socket then inter- 
prets the message through Transmission Control Protocol/Internet Protocol (TCP/IP). 
TCP/IP is the Standard set of protocols used for connecting computers and networks to a 
network of networks, known as the Internet. Most Internet transmissions are sent as sets of 
individual message pieces, called packets. At the sending side, the packets of one message 
are numbered sequentially, and error-control information is attached to each packet. IP is 
primarily responsible for routing packets to avoid traffic jams, so each packet might travel 
a different route over the Internet. The destination of a packet is determined by the IP 
address —an assigned number used to identify a computer on a network, similar to the 
address of a house in a neighborhood. At the receiving end, the TCP makes sure that ali of 
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the packets have arrived, puts them in sequential order and determines if the packets have 
arrived without alteration. If the packets have been accidentally altered or any data has been 
lost, TCP requests retransmission. However, TCP is not sophisticated enough to determine 
if packets have been maliciously altered during transmission, as malicious packets can be 
disguised as valid ones. When all of the data successfully reaches TCP/IP, the message is 
passed to the socket at the receiver end. The socket translates the message back into a form 
that can be read by the receiver’s application. 19 In a transaction using SSL, the sockets are 
secured using public-key cryptography. 

SSL implements public-key technology using the RSA algorithm and digital certifi- 
cates to authenticate the server in a transaction and to protect private information as it 
passes from one party to another over the Internet. SSL transactions do not require client 
authentication; many servers consider a valid credit-card number to be sufficient for 
authentication in secure purchases. To begin, a client sends a message to a server. The 
server responds and sends its digital certificate to the client for authentication. Using 
public-key cryptography to communicate securely, the client and server negotiate session 
keys to continue the transaction. Session keys are secret keys that are used for the duration 
of that transaction. Once the keys are established, the communication proceeds between the 
client and the server by using the session keys and digital certificates. Encrypted data is 
passed through TCP/IP, just as regular packets travel over the Internet. However, before 
sending a message with TCP/IP, the SSL protocol breaks the information into blocks, com¬ 
presses it and encrypts it. Conversely, after the data reaches the receiver through TCP/IP, 
the SSL protocol decrypts the packets, then decompresses and assembles the data. These 
extra processes provide an extra layer of security between TCP/IP and applications. SSL is 
primarily used to secure point-to-point connections —transmissions of data from one com¬ 
puter to another. 20 SSL allows for the authentication of the server, the client, both or nei- 
ther; in most Internet SSL sessions, only the server is authenticated. The Transport Layer 
Security (TLS) protocol, designed by the Internet Engineering Task Force, is similar to 
SSL. For more information on TLS, visit: www. ietf. org/rfc/rf c2246. txt. 

Although SSL protects information as it is passed over the Internet, it does not protect 
private information, such as credit-card numbers, once the information is stored on the mer- 
chant’s server. When a merchant receives credit-card information with an order, the infor¬ 
mation is often decrypted and stored on the merchant’s server until the order is placed. If 
the server is not secure and the data is not encrypted, an unauthorized party can access the 
information. Hardware devices, such as peripheral component interconnect (PCI) cards 
designed for use in SSL transactions, can be installed on Web servers to process SSL trans¬ 
actions, thus reducing processing time and leaving the server free to perform other tasks. 21 
Visit www. sonicwall. com/products/trans . asp for more information on these 
devices. For more information about the SSL protocol, check out the Netscape SSL tutorial 
at developer.netscape.com/tech/security/ssl/protocol.html and 
the Netscape Security Center site at www. netscape. com/security/ index.html. 

21.10.2 IPSec and Virtual Private Networks (VPN) 

Networks allow organizations to link multiple computers together. Local area netxvorks 
(LANs) connect computers that are physically close, generally in the same building. Widle 
area networks (WANs ) are used to connect computers in multiple locations using private 
telephone lines or radio waves. Organizations are now taking advantage of the existing in- 
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frastructure of the Internet—the publicly available wires—to create Virtual Private Net¬ 
works (VPNs), linking multiple networks, wireless users and other remote users. VPNs use 
the Internet infrastructure that is already in place, therefore they are more economical than 
private networks such as WANs. 22 The encryption allows for VPNs to provide the same 
Services as private networks over a public network. 

A VPN is created by establishing a secure tunnel through which data passes between 
multiple networks over the Internet. IPSec (Internet Protocol Security) is one of the tech- 
nologies used to secure the tunnel through which the data passes, ensuring the privacy and 
integrity of the data, as well authenticating the users. 23 IPSec, developed by the Internet 
Engineering Task Force (IETF), uses public-key and symmetric key cryptography to 
ensure authentication of the users, data integrity and confidentiality. The technology takes 
advantage of the Standard that is already in place, in which information travels between two 
networks over the Internet via the Internet Protocol ( IP ). Information sent using IP, how- 
ever, can easily be intercepted. Unauthorized users can access the network by using a 
number of well-known techniques, such as IP spoofing —a method in which an attacker 
simulates the IP of an authorized user or host to get access to resources that would other- 
wise be off-limits. The SSL protocol enables secure, point-to-point connections between 
two applications; IPSec enables the secure connection of an entire network. The Diffie- 
Hellman and RSA algorithms are commonly used in the IPSec protocol for key exchange, 
and DES or 3DES are used for secret-key encryption (depending on system and encryption 
needs). An IP packet is encrypted, then sent inside a regular IP packet that creates the 
tunnel. The receiver discards the outer IP packet, then decrypts the inner IP packet. 24 VPN 
security relies on three concepts—authentication of the user, encryption of the data sent 
over the network and controlled access to corporate information. 25 To address these three 
security concepts, IPSec is composed of three pieces. The Authentication Header (AH) 
attaches additional information to each packet, which verifies the identity of the sender and 
proves that data was not modified in transit. The Encapsulating Security Payload (ESP) 
encrypts the data using symmetric key ciphers to protect the data from eavesdroppers while 
the IP packet is being sent from one computer to another. The Internet Key Exchange (IKE) 
is the key-exchange protocol used in IPSec to determine security restrictions and to authen- 
ticate the encryption keys. 

VPNs are becoming increasingly popular in businesses. However, VPN security is dif- 
ficult to manage. To establish a VPN, ali of the users on the network must have similar Soft¬ 
ware or hardware. Although it is convenient for a business partner to connect to another 
company’s network via VPN, access to specific applications and files should be limited to 
certain authorized users versus all users on a VPN. 26 Firewalls, intrusion detection Software 
and authorization tools can be used to secure valuable data (Section 21.14). 

For more information about IPSec, visit the IPSec Developers Forum at www.ip- 
sec.com. Also, check out the Web site for the IPSec Working Group of the IETF at 
www.ietf.org/html.charters/ipsec-charter.html, 

21.11 Authentication 

As we discussed throughout the chapter, authentication is one of the fundamental require- 
ments for e-business and m-business security. In this section, we will discuss some of the 
technologies used to authenticate users in a network, such as Kerberos, biometrics and sin- 
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gle sign-on. We conclue the section with a discussion of Microsoft Passport—a technology 
that combines several methods of authentication. 

21.11.1 Kerberos 

Firewalls do not protect users from internal security threats to their local area network. In- 
ternal attacks are common and can be extremely damaging. For example, disgruntled em- 
ployees with network access can wreak havoc on an organization’s network or steal 
valuable proprietary information. It is estimated that 70 percent to 90 percent of attacks on 
corporate networks are internal. Kerberos is a freely available, open-source protocol de- 
veloped at MIT. It employs secret-key cryptography to authenticate users in a network and 
to maintain the integrity and privacy of network Communications. 

Authentication in a Kerberos system is handled by a main Kerberos system and a sec- 
ondary Ticket Granting Ser\’ice (TGS ). This system is similar to the key distribution centers 
described in Section 23.3. The main Kerberos system authenticates a client’s identity to the 
TGS; the TGS authenticates client’s rights to access specific network Services. 

Each client in the network shares a secret key with the Kerberos system. This secret 
key may be used by multiple TGSs in the Kerberos system. The client starts by entering a 
login name and password into the Kerberos authentication server. The authentication server 
maintains a database of ali clients in the network. The authentication server returns a 
Ticket-Granting Ticket ( TGT) encrypted with the client’s secret key that it shares with the 
authentication server. Since the secret key is known only by the authentication server and 
the client, only the client can decrypt the TGT, thus authenticating the client’s identity. 
Next, the client’s system sends the decrypted TGT to the Ticket Granting Service to request 
a Service ticket. The Service ticket authorizes the client’s access to specific network Ser¬ 
vices. Service tickets have a set expiration time. Tickets may be renewed by the TGS. 

21.11.2 Biometrics 

An innovation in security is likely to be biometrics. Biometrics uses unique personal infor¬ 
mation, such as fingerprints, eyeball iris scans or face scans, to identify a user. This system 
eliminates the need for passwords, which are rnuch easier to steal. Have you ever written 
down your passwords on a piece of paper and put the paper in your desk drawer or wallet? 
These days, people have passwords and PIN codes for everything—Web sites, networks, 
e-mail, ATM cards and even for their cars. Managing all of those codes can become a bur- 
den. Recently, the cost of biometrics devices has dropped significantly. Keyboard-mounted 
fingerprint scanning, face scanning and eye scanning devices are being used in place of 
passwords to log into systems, check e-mail or access secure information over a network. 
Each user’s iris scan, face scan or fingerprint is stored in a secure database. Each time a user 
logs in, his or her scan is compared with the database. If a match is made, the login is suc- 
cessful. Two companies that specialize in biometrics devices are IriScan 
(www. iri scan. com) and Keytronic (www. keytronic. com). For addi tional resourc- 
es, see Section 21.16. 

Currently, passwords are the predominant means of authentication; however, we are 
beginning to see a shift to smart cards and Biometrics. Microsoft recently announced that 
it will include the Biometric Application Programming Interface (BAPI) in future versions 
of Windows, which will make it possible for companies to integrate biometrics into their 
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systems. 28 Two-factor authentication uses two means to authenticate the user, such as bio- 
metrics or a smart card used in combination with a password. Though this system could 
potentially be compromised, using two methods of authentication is more secure than just 
using passwords alone. 

Keyware Inc. has already implemented a wireless biometrics system that Stores user 
voiceprints on a Central server. Keyware also created layered biometric verificatioji ( LBV ), 
which uses multiple physical measurements—face, finger and voice prints—simulta- 
neously. The LBV feature enables a wireless biometrics system to combine biometrics with 
other authentication methods, such as PIN and PK1. 29 

Identix Inc. also provides biometrics authentication technology for wireless transac- 
tions. The Identix fingerprint scanning device is embedded in handheld devices. The 
Identix Service offers transaction management and content protection Services. Transac- 
tion management Services prove that transactions took place, and content protection Ser¬ 
vices control access to electronic documents, including limiting a user’s ability to 
download or copy documents. 30 

Wireless biometrics is not widely used at this point. Fingerprint scanners must be 
accompanied by fingerprint readers installed in mobile devices. Wireless device manufac- 
turers are hesitant to build in fingerprint readers because the technology is expensive. Lap- 
tops have begun to accommodate biometric security, but cell phones are slower to advance 
due to limited memory and processing power. 31 

One of the major concerns with biometrics is the issue of privacy. Implementing fin¬ 
gerprint scanners means that organizations will be keeping databases with each employee’s 
fingerprint. Do people want to provide their employers with such personal information? 
What if that data is compromised? To date, most organizations that have implemented bio¬ 
metrics systems have received little, if any, resistance from employees. 

21.11.3 Single Sign-On 

To access multiple applications on different servers, users must provide a separate pass¬ 
word for authentication on each. Remembering multiple passwords is cumbersome. People 
tend to write their passwords down, creating security threats. 

Single sign-on systems allow users to login once with a single password. Users can 
access multiple applications. It is important to secure single sign-on passwords, because if 
the password becomes available to hackers, ali applications can be accessed and attacked. 

There are three types of single sign-on Services: workstcition logon scripts, authentica¬ 
tion server scripts and tokens. Workstation logon scripts are the simplest form of single 
sign-on. Users login at their workstations, then choose applications from a menu. The 
workstation logon script sends the user’s password to the application servers, and the user 
is authenticated for future access to those applications. Workstation logon scripts do not 
provide a sufficient amount of security since user passwords are stored on the PC in plain- 
text. Anyone who can access the workstation can take the user’s password. Authentication 
server scripts authenticate users with a Central server. The Central server Controls connec- 
tions between the user and the applications the user wishes to access. Authentication server 
scripts are more secure than workstation logon scripts because passwords are kept on the 
server, which is more secure than the individual PC. 

The most advanced single sign-on systems use token-based authentication. Once a user 
is authenticated, a non-reusable token is issued to the user to access specific applications. 
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The logon for creating the token is secured with encryption or with a single password, 
which is the only password the user needs to remember or change. The only problem with 
token authentication is that all applications must be built to accept tokens instead of tradi- 
tional logon passwords. 32 

21.11.4 Microsoft® Passport 

Microsoft Passport incorporates authentication, Online purchasing, single-sign on and sev- 
eral other technologies that we have discussed into one product that can be used over sev- 
eral different sites over the Internet. Passport users only need to sign in once, with the main 
Passport authentication server, and they will be recognized as a unique user at each of the 
Passport-enabled sites they visit. With this technology, users can sign in with a main server, 
and from that point, check their e-mail, chat with friends and make purchases Online—with- 
out entering a password for each application. 

Once a user logs in, the Passport provides authentication information to the partici- 
pating sites, but the actual Passport password is safe with the secured database. Passport 
uses SSL to send the username, password and digital wallet data to the Central server. 
[*** < m e mbe r s er vi C es.passport. COm /HELP/MSRY_HELP_howsecure.asp>***] The 
authentication information that sites receive is in the form of a digital key. This key is 
unique to each user and is verifiable by the Passport database (similar to the PKI architec- 
ture). To provide for a greater level of security, the Passport database and the sites that 
adapt this technology refresh the keys that are used in authentication. The less time that a 
key is in circulation, the less time an attacker has to analyze the key or use a compromised 
key. Microsoft Passport also provides for protection from brute-force cracking. If an 
attacker enters a certain number of incorrect passwords at the log in prompt, Passport tem- 
porarily suspends the account for several minutes. This action prevents brute-force pro- 
grams from repeatedly trying passwords until finding the correct one. 

Cookies on the user’s computer store profile information after it has been encrypted. 
When a user logs out of the Passport, all of the personal information that was stored in the 
cookies is deleted. 

Microsoft incorporates Passport technology into many of its upcoming products. Win¬ 
dows XP, the .NET framework and Hailstorm are based on Microsoft Passport. 

For more information on Microsoft Passport (and to sign up for a free Passport 
account), visit www.passport. com. 

21.12 Security Attacks 

Recent cyberattacks on e-businesses have made the front pages of newspapers worldwide. 
Denial-of-Service attacks ( DoS ), viruses and worms have cost companies billions of dol- 
lars. In this section, we will discuss the different types of attacks and the steps you can take 
to protect your information. 

21.12.1 Denial-of-Service (DoS) Attacks 

A denial-of-service attack occurs when a system is forced to behave improperly. In many 
DoS attacks, a network's resources are taken up by unauthorized traffic, restricting the ac- 
cess of legitimate users. Typically, the attack is performed by flooding servers with data 
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packets. Denial-of-Service attacks usually require the power of a network of computers 
working simultaneously, although some skillful attacks can be achieved with a single ma- 
chine. Denial-of-service attacks can cause networked computers to crash or disconnect, dis- 
rupting Service on a Web site or even shutting down critical systems such as 
telecommunications or flight-control centers 



e-Fact 21.6 _ 

Approximately 4,000 sites experience denial-of-service every week. 33 34 


Another type of denial-of-service attack targets the routing tables of a network. 
Routing tables are the road map of a network, providing directions for data to get from one 
computer to another. This type of attack is accomplished by modifying the routing tables, 
thus disabling network activity. For example, the routing tables can be changed to send all 
data to one address in the network. 

In a distributed denial-of-service attack, the packet llooding does not come from a 
single source, but from many separate computers. Actually, such an attack is rarely the con- 
certed work of many individuals. Instead, it is the work of a single individual who has 
installed viruses on various computers, gaining illegitimate use of the computers to carry 
out the attack. Distributed denial-of-service attacks can be difficult to stop, since it is not 
ciear which requests on a network are from legitimate users and which are part of the attack. 
In addition, it is particularly difficult to catch the culprit of such attacks, because the attacks 
are not carried out directly from the attacker's computer. 

Who is responsible for viruses and denial-of-service attacks? Most often the responsible 
parties are referred to as hackers or crackers. Hackers and crackers are usually skilled pro- 
grammers. According to some, hackers break into systems just for the thrill of it, without 
causing any harm to the compromised systems (except, perhaps. humbling and humiliating 
their owners). Either way, hackers break the law by accessing or damaging private Informa¬ 
tion and computers. Crackers have malicious intent and are usually interested in breaking into 
a system to shut down Services or steal data. In February 2000, distributed denial-of-service 
attacks shut down a number of high-traffic Web sites, including Yahoo!, eBay, CNN Interac¬ 
tive and Amazon. In this case, a cracker used a network of computers to flood the Web sites 
with traffic that overwhelmed the sites' computers. Although denial-of-service attacks 
merely shut off access to a Web site and do not affect the victim’s data, they can be 
extremely costly. For example, when eBay’s Web site went down for a 24-hour period on 

-2 C 

August 6, 1999, its stock value declined dramatically. 


21.12.2 Viruses and Worms 

Viruses are pieces of code—often sent as attachments or hidden in audio clips, video clips 
and games—that attach to, or overwrite other programs to replicate themselves. Viruses 
can corrupt files or even wipe out a hard drive. Before the Internet was invented, viruses 
spread through files and programs (such as video games) transferred to computers by re- 
movable disks. Today, viruses are spread over a network simply by sharing “infected” files 
embedded in e-mail attachments, documents or programs. A worm is similar to a virus, ex¬ 
cept that it can spread and infect files on its own over a network; worms do not need to be 
attached to another program to spread. Once a virus or worm is released, it can spread rap- 
idly, often infecting millions of computers worldwide within minutes or hours. 
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There are many classes of computer viruses. A transierit virus attaches itself to a spe- 
cific computer program. The virus is activated when the program is run and deactivated 
when the program is terminated. A more powerful type of virus is a resident virus , which, 
once loaded into the memory of a computer, operates for the duration of the computer's use. 
Another type of virus is the logic bomb, which triggers when a given condition is met, such 
as a time bomb that is activated when the clock on the computer matches a certain time or 
date. 

A Trojan horse is a malicious program that hides within a friendly program or simu- 
lates the identity of a legitimate program or feature, while actually causing damage to the 
computer or network in the background. The Trojan horse gets its name from the story of 
the Trojan War in Greek history. In this story, Greek warriors hid inside a wooden horse, 
which the Trojans took within the walls of the city of Troy. When night feli and the Trojans 
were asleep, the Greek warriors came out of the horse and opened the gates to the city, let- 
ting the Greek army enter the gates and destroy the city of Troy. Trojan horse programs can 
be particularly difficult to detect, since they appear to be legitimate and useful applications. 
Also commonly associated with Trojan horses are backdoor programs, which are usually 
resident viruses that give the sender complete, undetected access to the victim’s computer 
resources. These types of viruses are especially threatening to the victim, as they can be set 
up to log every keystroke (capturing ali passwords, credit card numbers, etc.) No matter 
how secure the connection between a PC supplying private information and the server 
receiving the information, if a backdoor program is running on a computer, the data is inter- 
cepted before any encryption is implemented. In June 2000, news spread of a Trojan horse 
virus disguised as a video clip sent as an e-mail attachment. The Trojan horse virus was 
designed to give the attacker access to infected computers, potentially to launch a denial- 
of-service attack against Web sites. 36 

Two of the most famous viruses to date are Melissa, which struck in March 1999, and 
the ILOVEYOU virus that hit in May 2000. Both viruses cost organizations and individuals 
billions of dollars. The Melissa virus spread in Microsoft Word documents sent via e-mail. 
When the document was opened, the virus was triggered. Melissa accessed the Microsoft 
Outlook address book on that computer and automatically sent the infected Word attach¬ 
ment by e-mail to the first 50 people in the address book. Each time another person opened 
the attachment, the virus would send out another 50 messages. Once in a system, the virus 
infected any subsequently saved files. 

The ILOVEYOU virus was sent as an attachment to an e-mail posing as a love letter. 
The message in the e-mail said “Kindly check the attached love letter coming from me.” 
Once opened, the virus accessed the Microsoft Outlook address book and sent out messages 
to the addresses listed, helping to spread the virus rapidly worldwide. The virus corrupted 
ali types of files, including system files. Networks at companies and government organiza¬ 
tions worldwide were shut down for days trying to remedy the problem and contain the 
virus. This virus accentuated the importance of scanning file attachments for security 
threats before opening them. 

g- e-Fact 21.7 _ 

[*_ Estimatesfor damage caused by the ILOVEYOU virus were as high as $10 billion to $15 bil- 
lion, with the majority ofthe damage done in just afew hours. 
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Why do these viruses spread so quickly? One reason is that many people are too 
willing to open executable files from unknown sources. Have you ever opened an audio clip 
or video clip from a friend? Have you ever forwarded that clip to other friends? Do you 
know who created the clip and if any viruses are embedded in it? Did you open the ILO VE 
YOU file to see what the love letter said? 

Most antivirus Software is reactive, going after viruses once they are discovered, rather 
than protecting against unknown viruses. New antivirus Software, such as Finjan Soft- 
ware’s SurfinGuard® (www. finjan. com), looks for executable files attached to e-mail 
and runs the executables in a secure area to test if they attempt to access and harm files. For 
more information about antivirus Software, see the McAfee.com: Antivirus Utilities fea- 
ture. 


McAfee. com: Antivirus Utilities 

McAfee . com provides a variety of antivirus Utilities (and other Utilities) for users 
whose computers are not continuously connected to a network, for users whose com- 
puters are continuously connected to a network (such as the Internet) and for users con¬ 
nected to a network via wireless devices, such as personal digital assistants. 

For computers that are not continuously connected to a network, McAfee provides 
its antivirus Software VirusScan®. This Software is configurable to scan files for 
viruses on demand or to scan continuously in the background as the user does his or her 
work. 

For computers that are network and Internet accessible, McAfee provides its 
Online McAfee. com Clinic. Users with a subscription to McAfee Clinic can use the 
Online virus Software from any computer they happen to be using. As with VirusScan 
Software on stand-alone computers, users can scan their files on demand. A major ben¬ 
efit of the Clinic is its ActiveShield Software. Once installed, ActiveShield can be con- 
figured to scan every file that is used on the computer or just the program files. It can 
also be configured to check automatically for virus definition updates and notify the 
user when such updates become available. The user simply clicks on the supplied 
hyperlink in an update notification to connect to the Clinic site and clicks on another 
hyperlink to download the update. Thus, users can keep their computers protected with 
the most up-to-date virus definitions at ali times, an important factor in protection from 
viruses. 

McAfee.com VirusScan Wireless provides virus protection for Palm™ handhelds, 
Pocket PC and other handheld devices. VirusScan Wireless is installed on the user’s 
PC. Each time the user syncs the handheld device, the Software scans for viruses. If a 
virus is detected, the sync is terminated until the user deletes the virus. For more infor¬ 
mation about McAfee, visit www.mcafee.com. Also, check out Norton security 
products from Symantec, at www.symantec.com, Symantec is a leading security 
Software vendor. Its product Norton™ Internet Security 2000 provides protection 
against hackers, viruses and threats to privacy for both small businesses and individ- 
uals. 
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21.12.3 Software Exploitation, Web Defacing and Cybercrime 

Another problem plaguing e-businesses is Software exploitation by hackers. In addition to 
constantly updating virus and firewall programs, every program on a networked machine 
should be checked for vulnerabilities. However, with millions of Software products avail- 
able and more vulnerabilities discovered daily, this becomes an enormous task. One com- 
mon vulnerability exploitation method is a buffer overflow, in which a program is 
overwhelmed by an input of more data than it has allocated space for. Buffer overflow at- 
tacks can cause systems to crash or, more dangerously, allow arbitrary code to be run on a 
machine. BugTraq was created in 1993 to list vulnerabilities, how to exploit them and how 
torepair them. For more information about BugTraq, visit www. security focus. com. 

Web defacing is another popular form of attack, wherein the crackers illegally enter an 
organization’s Web site and change the contents. CNN Interactive has issued a special 
report titled “Insurgency on the Internet,” with news stories about hackers and their Online 
attacks. Included is a gallery of defaced sites. One notable case of Web defacing occurred 
in 1996, when Swedish crackers changed the Central Intelligence Agency Web site 
(www. odei . gov/cia) to read “Central Stupidity Agency.” The vandals put obscenities, 
political messages, notes to system administrators and links to adult-content sites on the 
page. Many other popular and large Web sites have been defaced. Defacing Web sites has 
become overwhelmingly popular amongst crackers today, causing archives of affected sites 
(with records of more than 15,000 vandalized sites) to close because of the volume in which 
sites were being vandalized daily. 37 

Cybercrime can have significant financial implications on an organization. 38 Compa- 
nies need to protect their data, intellectual property, customer information, etc. Imple- 
menting a security policy is key to protecting an organization’s data and network. When 
developing a security plan, organizations must assess their vulnerabilities and the possible 
threats to security. What information do they need to protect? Who are the possible 
attackers and what is their intent—data theft or damaging the network? How will the orga¬ 
nization respond to incidents? 39 For more information about security and security pians, 
visit www.cerias.com and www.sans.org. Visit www.baselinesoft.com to 
check out books and CD-ROMs on security policies. Baseline Software’s book, Informa¬ 
tion Policies Made Easy: Version 7 includes over 1000 security policies. This book is used 
by numerous Fortune 200 companies. 


e-Fact 21.8 



According to the GartnerGroup, 70% of computer crime is committed by disgruntled em- 


ployees . 40 

The rise in cybercrimes has prompted the U. S. government to take action. Under the 
National Information Infrastructure Protection Act of 1996, denial-of-service attacks and 
distribution of viruses are federal crimes punishable by fines and jail time. For more infor¬ 


mation about the U. S. government’s efforts against cybercrime or to read about recently 


prosecuted cases, visit the U.S. Department of lustice Web site, at www.usdoj .gov/ 
criminal/cybercrime/compcrime. html. Also check out www.cyber¬ 
crime. gov, a site maintained by the Criminal Division of the U. S. Department of lus¬ 
tice. 

The CERT® (Computer Emergency Response Team) Coordination Center at Carnegie 
Mellon University’s Software Engineering Institute responds to reports of viruses and 
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denial-of-service attacks and provides information on network security, including how to 
determine if a system has been compromised. The site provides detailed incident reports of 
viruses and denial-of-service attacks, including descriptions of the incidents, their impact 
and Solutions. The site also includes reports of vulnerabilities in popular operating systems 
and Software packages. The CERT Security Improvement Modules are excellent tutorials 
on network security. These modules describe the issues and technologies used to solve net¬ 
work security problems. For more information, visit the CERT Web site, at 
www.cert.org. 

To learn more about how you can protect yourself or your network from hacker 
attacks, visit AntiOnline™, at www.antionline.com. This site has security-related 
news and information, a tutorial titled “Fight-back! Against Hackers,” information about 
hackers and an archive of hacked sites. You can find additional information about denial- 
of-service attacks and how to protect your site at www.irchelp.org/irchelp/ 
nuke. 

21.13 Running Resticted Python Code 

Python code is platform independent, so, once Python code is written it can be run virtually 
anywhere. Many programmers access Python code remotely by downloading it and run¬ 
ning it using a Python interpreter installed on the local system. This method raises security 
issues, however— once the code runs on a local machine it could gain unauthorized access 
to local files or otherwise misuse the machine. 

One solution to prevent executing damaging code is to run code in a restricted envi- 
ronment. Restricted environment is a Virtual machine that provides access only to the 
resources the program may need that are physically available on the local machine. If the 
code is unable to access sensitive resources (such as a hard drive or network) it will not be 
able to damage such resources. 

21.13.1 Module rexec 

Module rexec contains the RExec class used to execute Python code in a restricted en¬ 
vironment. An RExec instance supports several methods that perform restricted execution, 
such as r_eval. Code that executes in this environment has limited access to modules and 
built-in Python functions—the programmer has complete control over the environment in 
which the code runs. A default restricted environment imports several modules, including 

_builtlns _and sys. RExec only can restrict access to some resources such as a 

disk or network but it cannot limit the amount of memory or CPU time used. 

21.13.2 Module Bastion 

Module Bastion can be used to restrict access to specific objects, rather than the entire 
environment. The Bastion object wraps an object and Controls the access to this object. 
Bastion provides precise control over the methods of the object, achieved by supplying 
a filter function when creating a Bastion instance. The filter function takes a method 
name as an argument and returns true if that method can be accessed. By default, methods 
of the object are not accessible. 
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When code tries to access a restricted method, an AttributeError exception is 
thrown. This happens because, from the code’s point of view, the method does not exist. In 
the restricted environment, this method was never defined and thus it is not accessible. 

21.13.3 Web browser example 

Figure 21.7 demonstrates a modified version of the Web browser we presented in Chapter 
20 (Fig. 20.1). The modified browser checks whether the requested page ends with the . py 
extension. If so, the browser runs the Python code in a restricted environment. 


1 

# Fig. 21.7: fig20_02.py 





2 

# This program displays the contents 

of 

a file on 

a 

Web server. 

4 

from Tkinter import * 





5 

import tkMessageBox 





6 

import Pmw 





7 

import urllib 





8 

import urlparse 





9 

import Bastion 





10 

11 

import rexec 





12 

class WebBrowser( Frame ): 





13 






14 






15 

def init ( self ): 





16 






17 






18 

Frame._init_( self ) 





19 

Pmw.initialise() 





20 

self.pack( expand = , fili = 


) 



21 

self.master.title( 


) 



22 

self.master.geometry( 

) 




23 






24 

self.address = Entryt self ) 





25 

self.address.pack( fili = , padx 

= , pady 

= 

) 

26 

self.address.bind( , 

self.getPage 

) 


27 






28 

self.contents = Pmw.ScrolledText( 

self. 



29 

text_state = ) 





30 

self.contents.pack( expand = 

1 

fili = 

/ 

padx = , 

31 

pady = ) 





32 






33 

# create restricted environment 





34 

self.restricted = rexec.RExec() 





35 

self.module = self.restricted.add 

_module( 


) 

36 

self.environment = self.module. 

dict 



37 






38 

# add browser to environment 





39 

self.environment[ ] = 

Bastion.Bastion( self ) 

40 






41 

def setColort self, color ): 






Fig. 21.7 Web browser example. 
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42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 
81 
82 

83 

84 

85 

86 

87 

88 

89 

90 

91 

92 

93 

94 


self.configure( background = color ) 
def _setColor( self, color ): 

self.configure( background = color ) 
def setText( self, text ): 

self.contents.settext( text ) 
def runCode( self, statement ): 


try: 

self.restricted.r_exec( statement ) 
except AttributeError, name: 

tkMessageBox.showerror( , 

+ \ 


+ str( name ) ) 


def getPage( self, event ): 


# parse the URL 

myURL = event.widget.get() 

components = urlparse.urlparse( myURL ) 

self.contents.text_state = NORMAL 

# if addressing scheme not specifled, use http 

if components[ ] == : 

myURL = + myURL 

# connect and retrieve the file 
try: 

tempFile = urllib.urlopen( myURL ).read() 
except IOError: 

self.contents.settext( ) 

else: 

tempFile = tempFile.replace( , ) 

if myURL[-3:] == : 

self.runCode( tempFile ) 

else : 

self.contents.settext( tempFile ) 
self.contents.text_state = DISABLED 
def main(): 

WebBrowser().mainloop() 


Fig. 21.7 Web browser example. 
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95 

96 if _ name 

main() 



4 ^- 




JSJxl 


|localhostAest2.py 



Fig. 21.7 Web browser example. 
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Line 34 creates an instance of class RExec. Line 35 gets the environment’s_ main_ 

module of that environment. The instance defines an environment that contains a list of 
accessible modules and built-in functions (e.g. raw_input or abs). It has its own en¬ 
vironment, including a list of accessible modules and built in methods. Method 
add_module adds a new module to the list of the modules allowed in the restricted envi¬ 
ronment and returns a reference to that module. If the environment already permits access 
to the module, method add_module simply returns a reference to the specified module. 
Method add_module does not import the module into the restricted environment; the 
method only modifies the list of modules that the restricted code may import. 

Line 34 gets the reference to the dictionary_ dict _that contains the module- 

global bindings for the restricted environment. A Bastion module wraps a Web browser 
component and adds it to the module-global namespace of the restricted environment (line 
39). The restricted code now may access and manipulate the Web browser component. By 
wrapping the Web browser component with class Bastion, we allow the program to con- 
trol how the restricted code accesses the browser. By default, code many not access a Bas¬ 
tion instance’s data member or any methods that begin with the underscore (_) letter. The 
code may access method that do not begin with the underscore character. 

To demonstrate code execution, lines 41—49 add two methods to the WebBrowser. 
Both setColor (lines 41-44) and _setColor (lines 46-49) set the foreground color of 
the WebBrowser. By default, code may not access a Bastion-wrapped browser objecfs 
_setColor method. 

The screenshots inFig. 21.7 demonstrate the resuit of running the code in Fig. 21.8 and 
Fig. 21.9. The first screenshot is the browser in its original state. The second screenshot is 
the resuit of running the code in Fig. 21.8. The browser has changed its background color 
to blue. The final screenshot demonstrates what happens when the code in Fig. 21.7 
attempts to change color using restricted _setColor. 


1 browser.setColor( ) 

Fig. 21.8 


1 browser.setColor( ) 

Fig. 21.9 

21.14 NetWork Security 

The goal of network security is to allow authorized users access to information and Servic¬ 
es, while preventing unauthorized users from gaining access to, and possibly corrupting, 
the network. There is a trade-off between network security and network performance: In- 
creased security often decreases the efficiency of the network. 

In this section, we will discuss the various aspects of network security. We will discuss 
firewalls, which keep unauthorized users out of the network, and authorization servers, 
which allow users to access specific applications based on a set of pre-defined criteria. We 
will then look at intrusion detection systems that actively monitor a network for intrusions 
and attacks. 
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21.14.1 Firewalls 

A basic tool in network security is th q firewall. The purpose of a firewall is to protect a local 
area network ( LAN) from intruders outside the network. For example, most companies 
have internal networks that allow employees to share files and access company informa- 
tion. Each LAN can be connected to the Internet through a gateway, which usually includes 
a firewall. For years, one of the biggest threats to security came from employees inside the 
firewall. Now that businesses rely heavily on access to the Internet, an increasing number 
of security threats are originating outside the firewall—from the hundreds of millions of 
people connected to the company network by the Internet. 51 A firewall acts as a safety bar- 
rier for data flowing into and out of the LAN. Firewalls can prohibit ali data flow not ex- 
pressly allowed, or can allow all data flow that is not expressly prohibited. The choice 
between these two models is up to the network security administrator and should be based 
on the need for security versus the need for functionality. 

There are two main types of firewalls: packet-filtering firewalls and application-level 
gateways. A packet-filtering firewall examines all data sent from outside the LAN and 
rejects any data packets that have local network addresses. For example, if a hacker from 
outside the network obtains the address of a computer inside the network and tries to sneak 
a harmful data packet through the firewall, the packet-filtering firewall will reject the data 
packet, since it has an internal address, but originated from outside the network. A problem 
with packet-filtering firewalls is that they consider only the source of data packets; they do 
not examine the actual data. As a resuit, malicious viruses can be installed on an authorized 
user’s computer, giving the hacker access to the network without the authorized user’s 
knowledge. The goal of an application-level gateway is to screen the actual data. If the mes- 
sage is deemed safe, then the message is sent through to the intended receiver. 

Using a firewall is probably the most effective and easiest way to add security to a 
small network. 52 Often, small companies or home users who are connected to the Internet 
through permanent connections, such as DSL lines, do not employ strong security mea- 
sures. As a resuit, their computers are prime targets for crackers to use in denial-of-service 
attacks or to steal information. It is important for all computers connected to the Internet to 
have some degree of security for their systems. Numerous firewall Software products are 
available. Several products are listed in the Web resources in Section 6.15. 

Air gap technology is a network security solution that complements the firewall. It 
secures private data from external traffic accessing the internal network. The air gap sepa- 
rates the internal network from the external network, and the organization decides which 
information will be made available to external users. Whale Communications created the e- 
Gap System, which is composed of two computer servers and a memory bank. The memory 
bank does not run an operating system, therefore hackers cannot take advantage of common 
operating system weaknesses to access network information. 

Air gap technology does not allow outside users to view the network’s structure, pre- 
venting hackers from searching the layout for weak spots or specific data. The e-Gap Web 
Shuttle feature allows safe external access by restricting the system’s back office, which is 
where an organization’s most sensitive information and IT-based business processes are 
controlled. Users who want to access a network hide behind the air gap, where the authen- 
tication server is located. Authorized users gain access through a single sign-on capability, 
allowing them to use one log-in password to access authorized areas of the network. 
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The e-Gap Secure File Shuttle feature moves files in and out of the network. Each file 
is inspected behind the air gap. If the file is deemed safe, it is carried by the File Shuttle into 
the network. 53 

Air gap technology is used by e-commerce organizations to allow their clients and 
partners to access information automatically, thus reducing the cost of inventory manage- 
ment. Military, aerospace and government industries, which store highly sensitive informa¬ 
tion, use air gap technology. 


SANS Institute: Security Research and Education 

The System Administration, Networking and Security Institute (SANS), founded in 
1989, is a security research and education organization with over 96,000 members 
(www. sans.org). SANS sells security training, certification programs and publica- 
tions. The organization also offers several free, publicly-available Services such as se¬ 
curity alerts and news. 

Each year, SANS publishes the Roadmap to Security Tools and Services Poster — 
a resource that includes information about key security technologies, lists of security 
vendors that specialize in each technology and URLs with additional security informa¬ 
tion. The poster also includes directions on how to order approximately 20 white 
papers. To order a copy of the poster and to request copies of the technical white papers, 
go towww.sans.org/tools.htm, 

The SANS Information Security Reading Room is an excellent resource for secu¬ 
rity information. The site has hundreds of articles and case studies organized by secu¬ 
rity topic. Topics include authentication, attacking attackers, intrusion detection, 
securing code, standards and many more. For more information, visit 
www.sans.org/infosecFAQ/index.htm, 

SANS offers three free newsletters. SANS NewsBites is a free weekly e-mail news- 
letter that lists key security news articles with a short summary of each article and a link 
to the complete resource. Go to www.sans.org/newlook/digests/news- 
bites.htm to view the latest newsletter, to view past newsletters or to subscribe. 
Security Alert Consensus (SAC ) is a weekly summary of new security alerts and coun- 
termeasures. Subscribers can opt to receive information on specific operating systems 
based on their particular needs. The SANS Windows Security Digest lists Windows NT 
security updates, threats and bugs. To subscribe to any of the SANS e-mail newsletters, 
go towww.sans.org/sansnews. 

The SANS Global Incident Analysis Center (GIAC ) records current attacks and 
analyzes each attack. Network and systems administrators can use this information to 
help them defend their networks and systems against attacks. Reports are made readily 
available to the public at www.sans.org/giac.htm and www.inci¬ 
dent s .org. 


21.14.2 Intrusion Detection Systems 

What happens if a hacker gets inside your firewall? How do you know if an intruder has 
penetrated the firewall? Also, how do you know if unauthorized employees are accessing 
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restricted applications? Intrusion detection systems monitor networks and application log 
files —files containing information on files, including who accessed them and when—so if 
an intruder makes it into the network or an unauthorized application, the system detects the 
intrusion, halts the session and sets off an alarm to notify the system administrator. 54 

Host-based intrusion detection systems monitor system and application log files. They 
can be used to scan for Trojan horses, for example. Network-based intrusion detection Soft¬ 
ware monitors traffic on a network for any unusual patterns that might indicate DoS attacks 
or attempted entry into a network by an unauthorized user. Companies can then check their 
log files to determine if indeed there was an intrusion and if so, they can attempt to track 
the offender. Check out the intrusion detection products from Cisco (www.cisco. com/ 
warp/public/cc/pd/sqsw/sqidsz), Hewlett-Packard (www.hp.com/secu- 
rity/home .html) and Symantec (www. Symantec. com). 

The OCTAVE SM (Operationally Critical Threat, Asset and Vulnerability Evaluation) 
method, under development at the Software Engineering Institute at Carnegie Mellon Uni- 
versity, is a process for evaluating security threats of a system. There are three phases in 
OCTAVE: building threat profiles, identifying vulnerabilities, and developing security 
Solutions and pians. In the first stage, the organization identifies its important information 
and assets, then evaluates the levels of security required to protect them. In the second 
phase, the system is examined for weaknesses that could compromise the valuable data. 
The third phase is to develop a security strategy as advised by an analysis team of three to 
five security experts assigned by OCTAVE. This approach is one of the firsts of its kind, 
in which the owners of computer systems not only get to have professionals analyze their 
systems, but also participate in prioritizing the protection of crucial information. 55 

21.15 Steganography 

Steganography is the practice of hiding information within other information. The term lit- 
erally means “covered writing.” Like cryptography, steganography has been used since an- 
cient times. Steganography allows you to take a piece of information, such as a message or 
image, and hide it within another image, message or even an audio clip. Steganography 
takes advantage of insignificant space in digital files, in images or on removable disks. 56 
Consider a simple example: If you have a message that you want to send secretly, you can 
hide the information within another message, so that no one but the intended receiver can 
read it. For example, if you want to teli your stockbroker to buy a stock and your message 
must be transmitted over an unsecure channel, you could send the message “BURIED UN¬ 
DER YARD.” If you have agreed in advance that your message is hidden in the first letters 
of each word, the stock broker picks these letters off and sees “BUY.” 

An increasingly popular application of steganography is digital watermarks for intel- 
lectual property protection. An example of a conventional watermark is shown in 
Fig. 21.10. A digital watermark can be either visible or invisible. It is usually a company 
logo, Copyright notification or other mark or message that indicates the owner of the docu- 
ment. The owner of a document could show the hidden watermark in a court of law, for 
example, to prove that the watermarked item was stolen. 

Digital watermarking could have a substantial impact on e-commerce. Consider the 
music industry. Music publishers are concerned that MP3 technology is allowing people to 
distribute illegal copies of songs and albums. As a resuit, many publishers are hesitant to 
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put content Online, as digital content is easy to copy. Also, since CD-ROMs are digital, 
people are able to upload their music and share it over the Web. Using digital watermarks, 
music publishers can make indistinguishable changes to a part of a song at a frequency that 
is not audible to humans, to show that the song was, in fact, copied. Microsoft Research is 
developing a watermarking system for digital audio, which would be included with default 
Windows media players. In this digital watermarking system, data such as licensing infor- 
mation is embedded into a song; the media player will not play files with invalid informa- 
tion. 



e-Fact 21.9 

Record Companies are losing approximately $5 billion per year clue to piracy. 57 


Blue Spike’s Giovanni™ digital watermarking Software uses cryptographic keys to 
generate and embed steganographic digital watermarks into digital music and images (Fig. 
7.8). The watermarks can be used as proof of ownership to help digital publishers protect 
their copyrighted material. The watermarks are undetectable by anyone who is not privy to 
the embedding scheme, and thus the watermarks cannot be identified and removed. The 
watermarks are placed randomly. 



Watermarks assist in preventing 
fraud, tamperproofing and 
authenticating. 


(0 BLUE SPIKE, INC. 


A watennark depicting 
Benjamin Franklin is 
visible from both sides 
when held up to a light 


Fig. 21.10 Example of a conventional watermark. (Courtesy of Blue Spike, Inc.) 
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Information 


Digital Security 


Watermark 


0010001000010101 




Process 


Giovanni 

Digital 

Watermark 


01000100 10101 

Multiple watermark layers 
accessible by separate 
keys 


© BLUE SPIKE, INC. 


Fig. 21.11 An example of steganography: Blue Spike's Giovanni digital 
watermarking process. (Courtesy of Blue Spike, Inc.) 

Giovanni incorporates cryptography and steganography. It generates a secret key 
based on an encryption algorithm and the contents of the audio or image file. The key is 
then used to place (and eventually decode) the watermark in the file. The Software identifies 
the perceptually insignificant areas of the image or audio file, enabling a digital watermark 
to be embedded inaudibly, invisibly and in such a way that if the watermark is removed, 
the content is likely to be damaged. 

Digital watermarking capabilities are built into some image-editing Software applica- 
tions, such as Adobe PhotoShop 5.5 (www.adobe.com), Companies that offer digital 
watermarking Solutions include Digimarc (www.digimark.com) and Cognicity 

(www. cognicity. com). 

In the last few chapters, we discussed the technologies involved in building and run- 
ning an m-business, and how to secure online and wireless transactions and Communica¬ 
tions. In Chapter 7, Legal, Ethical and Social Issues; Web Accessibility, we discuss a 
number of major legal and ethical concerns that have developed from the introduction of 
the Internet and the World Wide Web. 

21.16 Internet and World Wide Web Resources 

Security Resource Sites 
www.securitysearch.com 

This is a comprehensive resource for computer security. The site has thousands of links to products, 
security companies, tools and more. The site also offers a free weekly newsletter with information 
about vulnerabilities. 
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www.esecurityonline.com 

This site is a great resource for information on Online security. The site has links to news, tools, events, 
training and other valuable security information and resources. 

theory.lcs.mit.edu/~rivest/crypto- security.html 

The Ronald L. Rivest: Cryptography and Security site has an extensive list of links to security resourc¬ 
es, including newsgroups, government agencies, FAQs, tutorials and more. 

www.w3.org/Security/Overview.html 

The W3C Security Resources site has FAQs, information about W3C security and e-commerce initi- 
atives and links to other security related Web sites. 

web.mit.edu/network/ietf/sa 

The Internet Engineering Task Force (IETF), which is an organization concemed with the architecture 
of the Internet, has working groups dedicated to Internet Security. Visit the IETF Security Area to 
leam about the working groups, join the mailing list or check out the latest drafts of the IETF’s work. 

dir .yahoo.com/Computers_and_Internet/Security_and_Encryption 

The Yahoo Security and Encryption page is a great resource for links to Web sites security and en- 
cryption. 

www.counterpane.com/hotlist.html 

The Counterpane Internet Security, Inc., site includes links to downloads, source code, FAQs, tutori¬ 
als, alert groups, news and more. 

www.rsasecurity.com/rsalabs/faq 

This site is an excellent set of FAQs about cryptography from RSA Laboratories, one of the leading 
makers of public key cryptosystems. 

www.nsi.org/compsec.html 

Visit the National Security Institute’s Security Resource Net for the latest security alerts, government 
standards, and legislation, as well as security FAQs links and other helpful resources. 

www.itaa.org/infosec 

The Information Technology Association of America (ITAA) InfoSec site has information about the 
latest U.S. government legislation related to information security. 

staff.washington.edu/dittrich/misc/ddos 

The Distributed Denial of Service Attacks site has links to news articles, tools, advisory organizations 
and even a section on security humor. 

www.infoworld.com/cgi-bin/displayNew.pl7/security/links/ 
security_corner.htm 

The Security Watch site on Infoword.com has loads of links to security resources. 

www.antionline.com 

AntiOnline has security-related news and information, a tutorial titled “Fight-back! Against Hack- 
ers,” information about hackers and an archive of hacked sites. 

www.microsoft.com/security/default.asp 

The Microsoft security site has links to downloads, security bulletins and tutorials. 

www.grc.com 

This site offers a Service to test the security of your computer’s Internet connection. 

www.sans.org/giac.html 

Sans Institute presents information on system and security updates, along with new research and dis- 
coveries. The site offers current publications, projects, and weekly digests. 
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www.pactetstorm.securify.com 

The Packet Storm page describes the twenty latest advisories, tools, and exploits. This site also pro¬ 
vides links to the top security news stories. 

www.xforce. iss.net 

This site allows one to search a virus by name, reported date, expected risk, or affected platforms. Up- 
dated news reports can be found on this page. 

www.ntbugtraq.com 

This site provides a list and description of various Windows NT Security Exploits/Bugs encountered 
by Windows NT users. One can download updated Service applications. 

nsi.org/compsec.html 

The Security Resource Net page States various wamings, threats, legislation and documents of viruses 
and security in an organized outline. 

www.securitystats.com 

This computer security site provides statistics on viruses, web defacements and security spending. 

Magazines, Newsletters and News sites 

www.networkcomputing.com/consensus 

The Security Alert Consensus is a free weekly newsletter with information about security threats, 
holes, Solutions and more. 

www.at s take.com/security_news 

Visit this site for daily security news. 

www.infosecuritymag.com 

Information Security Magazine has the latest Web security news and vendor information. 

www.issl.org/cipher.html 

Cipher is an electronic newsletter on security and privacy from the Institute of Electrical and Elec¬ 
tronics Engineers (IEEE). You can view current and past issues Online. 

securityportal.com 

The Security Portal has news and information about security, cryptography and the latest viruses. 

www.scmagazine.com 

SC Magazine has news, product reviews and a conference schedule for security events. 

www.cnn.com/TECH/specials/hackers 

Insurgency on the Internet from CNN Interactive has news on hacking, plus a gallery of hacked sites. 

Government Sites for Computer Security 

www.cit.nih.gov/security.html 

This site has links to security organizations, security resources and tutorials on PKI, SSL and other 
protocols. 

cs-www.ncsl.nist.gov 

The Computer Security Resource Clearing House is a resource for network administrators and others 
concerned with security. This site has links to incident-reporting centers, information about security 
standards, events, publications and other resources. 

www.cdt.org/crypto 

Visit the Center for Democracy and Technology for U. S. legislation and policy news regarding cryp¬ 
tography. 
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www.epm.orni.gov/-dunigan/security.html 

This site has links to loads of security-related sites. The links are organized by subject and include 
resources on digital signatures, PKI, smart cards, viruses, commercial providers, intrusion detection 
and several other topics. 

www.alw.nih.gov/Security 

The Computer Security Information page is an excellent resource, providing links to news, news- 
groups, organizations, Software. FAQs and an extensive number of Web links. 

www.fedcirc.gov 

The Federal Computer Incident Response Capability deals with the security of government and civil- 
ian agencies. This site has information about incident statistics, advisories, tools, patches and more. 

axion.physics.ubc.ca/pgp.html 

This site has a list of freely available cryptosystems, along with a discussion of each system and links 
to FAQs and tutorials. 

www.ifccfbi.gov 

The Internet Fraud Complaint Center, founded by the Justice Department and the FBI, fields reports 
of Internet fraud. 

www.disa.mil/infosec/iaweb/default.html 

The Defense Information Systems Agency’s Information Assurance page includes links to sites on 
vulnerability warnings, virus information and incident-reporting instructions, as well as other helpful 
links. 

www.nswc. navy.mil/ISSEC/ 

The objective of this site is to provide information on protecting your computer systems from security 
hazards. Contains a page on hoax versus real viruses. 

www.cit.nih.gov/security.html 

You can report security issues at this site. The site also lists official federal security policies, regula- 
tions, and guidelines. 

cs-www.ncsl .nist.gov/ 

The Computer Security Resource Center provides Services for vendors and end users. The site in¬ 
cludes information on security testing, management, technology, education and applications. 

Advanced Encryption Standard (AES) 

csrc.nist.gov/encryption/aes 

The official site for the AES includes press releases and a discussion forum. 

www.esat.kuleuven.ac.be/~rijmen/rijndael/ 

Visit this site for information about the Rijndael algorithm. 

horne.ecn.ab.ca/~j savard/crypto/co040801.htm 

This AES site includes an explanation of the algorithm with helpful diagrams and examples. 

Internet Security Vendors 

www.rsasecurity.com 

RSA is one of the leaders in electronic security. Visit its site for more information about its current 
products and tools, which are used by companies worldwide. 

www.ca.com/protection 

Computer Associates is a vendor of Internet security Software. It has various Software packages to 
help companies set up a firewall, scan files for viruses and protect against viruses. 
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www.checkpoint.com 

Check Point™ Software Technologies Ltd. is a leading provider of Internet security products and Ser¬ 
vices. 

www.opsec.com 

The Open Platform for Security (OPSEC) has over 200 partners that develop security products and 
Solutions using the OPSEC to allow for interoperability and increased security over a network. 

www.baltimore.com 

Baltimore Security is an e-commerce security Solutions provider. Their UniCERT digital certificate 
product is used in PKI applications. 

www.ncipher.com 

nCipher is a vendor of hardware and Software products, including an SSL accelerator that increases 
the speed of secure Web server transactions and a secure key management system. 

www.entrust.com 

Entrust Technologies provides e-security products and Services. 

www.antivirus.com 

ScanMail® is an e-mail virus detection program for Microsoft Exchange. 

www. zixmail.com 

Zixmail™ is a secure e-mail product that allows you to encrypt and digitally sign your messages using 
different e-mail programs. 

web.mit.edu/network/pgp.html 

Visit this site to download Pretty Good Privacy® freeware. PGP allows you to send messages and 
files securely. 

www.certicom.com 

Certicom provides security Solutions for the wireless Internet. 

www.raytheon.com 

Raytheon Corporation’s SilentRunner monitors activity on a network to find intemal threats, such as 
data theft or fraud. 

SSL 

developer.netscape.com/tech/security/ssl/protocol.html 

This Netscape page has a brief description of SSL, plus links to an SSL tutorial and FAQs. 

www.netscape.com/security/index.html 

The Netscape Security Center is an extensive resource for Internet and Web security. You will fmd 
news, tutorials, products and Services on this site. 

psych .psy.uq.oz.au/ -ftp/Crypto 

This FAQs page has an extensive list of questions and answers about SSL technology. 

www.visa.com/nt/ecomm/security/main.html 

Visa International’s security page includes information on SSL and SET. The page includes a dem- 
onstration of an online shopping transaction, which explains how SET works. 

www .openssl.org 

The Open SSL Project provides a free, open source toolkit for SSL. 

Public-key Cryptography 

www.entrust.com 

Entrust produces effective security Software products using Public Key Infrastructure (PKI). 
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www.cse.dnd.ca 

The Communication Security Establishment has a short tutorial on Public Key Infrastructure (PKI) 
that defines PKI, public-key cryptography and digital signatures. 

www.magnet.state.ma.us/itd/legal/pki.htm 

The Commonwealth of Massachusetts Information Technology page has loads of links to sites related 
to PKI that contain information about standards, vendors, trade groups and government organizations. 

www.ftech.net/-monark/crypto/index.htm 

The Beginner's Guide to Cryptography is an Online tutorial and includes links to other sites on privacy 
and cryptography. 

www.faqs.org/faqs/cryptography-faq 

The Cryptography FAQ has an extensive list of questions and answers. 

www.pkiforum.org 

The PKI Forum promotes the use of PKI. 

www.counterpane.com/pki-risks.html 

Visit the Counterpane Internet Security, Inc.'s site to read the article “Ten Risks of PKI: What You're 
Not Being Told About Public Key Infrastructure.” 

Digital Signatures 

www.ietf.org/html .charters/xmldsig-charter.html 

The XML Digital Signatures site was created by a group working to develop digital signatures using 
XML. You can view the group’s goals and drafts of their work. 

www.elock.com 

E-Lock Technologies is a vendor of digital-signature products used in Public Key Infrastructure. This 
site has an FAQs list covering cryptography, keys, certificates and signatures. 

www.digsigtrust.com 

The Digital Signature Trust Co. is a vendor of Digital Signature and Public Key Infrastructure prod¬ 
ucts. It has a tutorial titled “Digital Signatures and Public Key Infrastructure (PKI) 101.” 

Digital Certificates 

www.verisign.com 

VeriSign creates digital IDs for individuals, small businesses and large coiporations. Check out its 
Web site for product information, news and downloads. 

www.thawte.com 

Thawte Digital Certificate Services offers SSL, developer and personal certificates. 

www.silanis.com/index.htm 

Silanis Technology is a vendor of digital-certificate Software. 

www.belsign.be 

Belsign issues digital certificates in Europe. It is the European authority for digital certificates. 

www.certco.com 

Certco issues digital certificates to financial institutions. 

www.openc a.org 

Set up your own CA using open-source Software frorn The OpenCA Project. 
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Digital Wallets 

www.globeset.com 

GlobeSet is a vendor of digital-wallet Software. Its site has an animated tutorial demonstrating the use 
of an electronic wallet in an SET transaction. 

www.trintech.com 

Trintech digital wallets handle SSL and SET transactions. 

wallet.yahoo.com 

The Yahoo! Wallet is a digital wallet that can be used at thousands of Yahoo! Stores worldwide. 

Firewalls 

www.interhack.net/pubs/fwfaq 

This site provides an extensive list of FAQs on firewalls. 

www.spirit.com/cgi-bin/report.pl 

Visit this site to compare firewall Software from a variety of vendors. 

www.zeuros. co.uk/generic/resource/firewall 

Zeuros is a complete resource for information about firewalls. You will find FAQs, books, articles, 
training and magazines on this site. 

www.thegild.com/firewall 

The Firewall Product OverView site has an extensive list of firewall products, with links to each ven- 
dor’s site. 

csrc.ncsl.nist.gov/nistpubs/800-10 

Check out this firewall tutorial from the U.S. Department of Commerce. 

www.watchguard.com 

WatchGuard® Technologies, Inc., provides firewalls and other security Solutions for medium to large 
organizations. 

Kerberos 

www.nrl .navy.mil/CCS/people/kenh/kerberos-faq.html 

This site is an extensive list of FAQs on Kerberos from the Naval Research Laboratory. 

web.mit.edu/kerberos/www 

Kerberos: The NetWork Authentication Protocol is a list of FAQs provided by MIT. 

www.contrib.andrew.cmu.edu/-shadow/kerberos.html 

The Kerberos Reference Page has links to several informational sites, technical sites and other helpful 
resources. 

www.pdc.kth.se/kth-krb 

Visit this site to download various Kerberos white papers and documentation. 

Biometrics 

www.iosoftware.com/products/integration/fiu500/ index.htm 

This site describes a security device that scans a user’s fingerprint to verify identity. 

www.identix.com/flash_index.html 

Identix specializes in fingerprinting systems for law enforcement, access control and network securi¬ 
ty. Using its fingerprint scanners, you can log on to your system, encrypt and decrypt files and lock 
applications. 
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www.iriscan.com 

Iriscan’s PR Iris™ can be used for e-commerce, network and information security. The scanner takes 
an image of the user’s eye for authentication. 

www.keytronic.com 

Key Tronic manufactures keyboards with fingeiprint recognition systems. 

IPSec and VPNs 

www.checkpoint.com 

Check Point™ offers combined firewall and VPN Solutions. Visit their resource library for links to 
numerous white papers, industry groups, mailing lists and other security and VPN resources. 

www.ietf.org/html .charters/ipsec-charter.html 

The IPSec Working Group of the Internet Engineering Task Force (IETF) is a resource for technical 
information related to the IPSec protocol. 

www.icsalabs.com/html/communities/ipsec/certification/ 
certified_products/index.shtml 

Visit this site for a list of certified IPSec products, plus links to an IPSec glossary and other related 
resources. 

www.ip-sec.com 

The IPSec Developers Forum allows vendors and users to test the interoperability of different IPSec 
products. The site includes technical documents related to the IPSec protocol. 

www.vpnc.org 

The Virtual Private NetWork Consortium, which has VPN standards, white papers, definitions and ar- 
chives. VPNC also offers compatibility testing with current VPN standards. 

Steganography and Digital Watermarking 

www.bluespike.com/giovanni/ giovmain.html 

Blue Spike’s Giovanni watermarks help publishers of digital content protect their copyrighted mate- 
rial and track their content that is distributed electronically. 

www.outguess.org 

Outguess is a freely available steganographic tool. 

www .cl.cam.ac.uk/-f app2/steganography/index.html 

The Information Hiding Homepage has technical information, news and links related to digital wa¬ 
termarking and steganography. 

www.demcom.com 

DemCom’s Steganos Security Suite Software allows you to encrypt and hide files within audio, video, 
text or HTML files. 

www.cognicity.com 

Cognicity specializes in digital-watermarking Solutions for the music and entertainment industries. 
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Newsgroups 

news:comp.security.firewalls 
news:comp.security.unix 
news:comp.security.misc 
news:comp.protocols.kerberos 


TERMINOLOGY 

128-bit IV 
3DES 

ActiveShield 

Advanced Encryption Standard (AES) 
application-Ievel gateway 
assemblies 

asymmetric algorithm 

authentication 

authentication header (AH) 

availability 

backdoor program 

binary string 

biometrics 

bit 

block 

block cipher 
brute-force cracking 
buffer overflow 
BugTraq 
Caesar cipher 

CERT (Computer Emergency Response Team) 

CERT Security Improvement Modules 

certificate authority (CA) 

certificate authority hierarchy 

certificate repository 

certificate revocation list (CRL) 

cipher 

ciphertext 

collision 

contact interface 

contactless interface 

content protection 

CPU 

cracker 

cryptanalysis 

cryptanalytic attack 

cryptography 

cryptosystem 

Data Encryption Standard (DES) 

data packet 

decryption 

denial-of-service (DoS) attack 

denial-of-service attack 

DES cracker machine 

Diffie-Hellman Key Agreement Protocol 

digital certificate 

digital envelope 

digital ID 

digital signature 

Digital Signature Algorithm (DSA) 
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digital watermarking 
distributed denial-of-service attack 
Dynamic Proxy Navigation (DPN) 
electronic shopping cart 
Elliptic Curve Cryptography (ECC) 

Encapsulating Security Payload (ESP) 
encryption 

Enhanced Security NetWork (ESN) 

firewall 

gateway 

GSM (Global System for Mobile Communications) 
hacker 

hash function 
hash value 
identity permissions 
ILOVEYOU Virus 
initialization vector (IV) 
integrity 

integrity check (IC ) 

Internet Engineering Task Force (IETF) 

Internet Key Exchange (IKE) 

Internet Policy Registration Authority (IPRA) 

Internet Protocol (IP) 

Internet Security, Applications, Authentication and Cryptography (ISAAC) 

IP address 
IP spoofing 

IPSec (Internet Protocol Security) 

IV collision 

Kerberos 

key 

key agreement protocol 
key distribution center 
key generation 
key length 
key management 

layered biometric verification (LBV) 

Liberty Trojan horse 

Lightweight Extensible Authentication Protocol (LEAP) 
local area network (LAN) 
logic bomb 
Lucifer 

man-in-the-middle attack 

masquerading 

MD5 hashing algorithm 

Melissa Virus 

memory card 

message digest 

message integrity 

microprocessor card 

Microsoft Authenticode 

Microsoft Intermediate Language (MSIL) 

Microsoft Passport 
mobile code 

Mobile Wireless Internet Forum 

Mobiletrust certificate authority 

National Institute of Standards and Technology (NIST) 

network security 

nonrepudiation 

Online Certificate Status Protocol (OCSP) 
packet 

packet-filtering firewall 

PCI (peripheral component interconnect) card 
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permissions 

personal Identification number (PIN) 
plaintext 

point-to-point connection 

policy creation authority 

Pretty Good Privacy (PGP) 

privacy 

private key 

protocol 

public key 

Public Key Infrastructure (PKI) 
public-key algorithms 
public-key cryptography 
resident virus 
restricted algorithms 
Rijndael 

role based access control (RBAC) 

root certificate authority 

root key 

routing table 

RSA encryption memory 

RSA Security, Inc. 

secret key 

Secure Enterprise Proxy 
Secure Sockets Layer (SSL) 
security policy file 
Service ticket 
session key 
single sign-on 
smart card 
Socket 

Software exploit 
steganography 
substitution cipher 
symmetric encryption algorithm 

TCP/IP (Transmission Control Protocol/Intemet Protocol) 
Ticket Granting Service (TGS) 

Ticket Granting Ticket (TGT) 

time bomb 

timestamping 

timestamping agency 

transaction management 

transient virus 

transposition cipher 

Triple DES 

Trojan horse virus 

Trustpoint 

VeriSign 

Virtual Private NetWork (VPN) 
virus 

Web defacing 

Wide area network (WAN) 

worm 


4 ^ 


SELF-REVIEW EXERCISES 

21.1 State whether the following are true or false. If the answer is false, explain why. 

a) In a public-key algorithm, one key is used for both encryption and decryption. 

b) Digital certificates are intended to be used indefinitely. 

c) Secure Sockets Layer protects data stored on a merchant’s server. 
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d) Digital signatures can be used to provide undeniable proof of the author of a document. 

e) In a network of 10 users communicating using public-key cryptography, only 10 keys are 
needed in total. 

f) The security of modem cryptosystems lies in the secrecy of the algorithm. 

g) Increasing the security of a network often decreases its functionality and efficiency. 

h) Firewalls are the single most effective way to add security to a small computer network. 

i) Kerberos is an authentication protocol that is used over TCP/IP networks. 

j) SSL can be used to connect a network of computers over the Internet. 

k) Hacker attacks, such as Denial-of-Service and viruses, can cause e-business to lose bil- 
lions of dollars. 

21.2 Fili in the blanks in each of the following statements: 

a) Cryptographic algorithms in which the message’s sender and receiver both hold an iden- 

tical key are called_. 

b) A_is used to authenticate the sender of a document. 

c) In a_, a document is encrypted using a secret key and sent with that secret key, 

encrypted using a public-key algorithm. 

d) A certificate that needs to be revoked before its expiration date is placed on a 


e) The recent wave of network attacks that have hit companies such as eBay, and Yahoo are 

known as_. 

f) A digital fingerprint of a document can be created using a_. 

g) The four main issues addressed by cryptography are _, _, 

_and_. 

h) A customer can store purchase information and data on multiple credit cards in an elec- 

tronic purchasing and storage device called a_. 

i) Trying to decrypt ciphertext without knowing the decryption key is known as 


j) A barrier between a small network and the outside world is called a_. 

k) A hacker that tries every possible solution to crack a code is using a method known as 


ANSWERS TO SELF-REVIEW EXERCISES 

21.1 a) False. The encryption key is different from the decryption key. One is made public, and 
the other is kept private, b) False. Digital certificates are created with an expiration date to encourage 
users to change their public/private-key pair periodically. c) False. Secure Sockets Layer is an Inter¬ 
net security protocol, which secures the transfer of information in electronic communication. It does 
not protect data stored on a merchanfs server, d) False. A user who digitally signed a document could 
later intentionally give up his or her private key and then claim that the document was written by an 
imposter. Thus, timestamping a document is necessary, so that users cannot repudiate documents 
written before the pubic/private-key pair is reported as invalidated. e) False. Each user needs a public 
key and a private key. Thus, in a network of 10 users, 20 keys are needed in total. f) False. The secu¬ 
rity of modem cryptosystems lies in the secrecy of the encryption and decryption keys. g) True. h) 
Trae. i) True. j) False, IPSec can connect a whole network of computers, while SSL can only connect 
two secure systems. k) True. 

21.2 a) symmetric key algorithms. b) digital signature, c) digital envelope. d) certificate revoca- 
tion list. e) distributed denial-of-service attacks. f) hash function. g) privacy, authentication, integrity, 
non-repudiation. h) electronic wallet. i) cryptanalysis. j) firewall. k) brute-force hacking. 
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EXERCISES 

21.3 What can Online businesses do to prevent hacker attacks, such as denial-of-service attacks 
and virus attacks? 

21.4 Define the following security terms: 

a) digitai signature 

b) hash function 

c) symmetric key encryption 

d) digitai certificate 

e) denial-of-service attack 

f) worm 

g) message digest 

h) collision 

i) triple DES 

j) session keys 

21.5 Define each of the following security terms, and give an example of how it is used: 

a) secret-key cryptography 

b) public-key cryptography 

c) digitai signature 

d) digitai certificate 

e) hash function 

f) SSL 

g) Kerberos 

h) firewall 

21 .6 Write the full name and describe each of the following acronyms: 

a) PKI 

b) IPSec 

c) CRL 

d) AES 

e) SSL 

21 .7 List the four problems addressed by cryptography, and give a real-world example of each. 

21.8 Compare symmetric-key algorithms with public-key algorithms. What are the benefits and 
drawbacks of each type of algorithm? How are these differences manifested in the real-world uses of 
the two types of algorithms? 
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[***Notes To Reviewers***] 

• Please pay close attention to Sections 21.8 and 21.13—the Python-specific sections. 

• We will post this chapter (with Solutions to exercises) for second-round review. 

• Please mark your comments in place on a paper copy of the chapter. 

• Please return only marked pages to Deitel & Associates, Inc. 

• Please do not send us e-mails with detailed, line-by-line comments; mark these directly on the pa¬ 
per pages. 

• Please feel free to send any lengthy additional comments by e-mail to cheryl .yaeger@dei- 
tel.net. 

• Please run all the code examples. 

• Please check that we are using the correct programming idioms. 

• Please check that there are no inconsistencies, errors or omissions in the chapter discussions. 

• The manuscript is being copyedited by a professional copy editor in parallel with your reviews. 
That person will probably find most typos, spelling errors, grammatical errors, etc. 

• Please do not rewrite the manuscript. We are concemed mostly with technical correctness and cor¬ 
rect use of idiom. We will not make significant adjustments to our writing style on a global scale. 
Please send us a short e-mail if you would like to make such a suggestion. 

• Please be constructive. This book will be published soon. We all want to publish the best possible 
book. 

• If you find something that is incorrect, please show us how to correct it. 

• Please read all the back matter including the exercises and any Solutions we provide. 

• Please review the index we provide with each chapter to be sure we have covered the topics you 
feel are important. 
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Data Structures 


Objectives 

• To be able to foim linked data structures using self- 
referential classes and recursion. 

• To be able to create and manipulate dynamic data 
structures such as linked lists, queues, stacks and 
binary trees. 

• To understand various important applications of 
linked data structures. 

• To understand how to create reusable data structures 
with inheritance and composition. 

Much that 1 bound, I could notfree; 

Much that I freed returned to me. 

Lee Wilson Dodd 

‘Willyou walk a little faster?’ saida whiting to a snail, 
‘There 's a porpoise close behind us, and he’s treading on my 
tail.’ 

Lewis Carroll 

There is always room at the top. 

Daniel Webster 
Push on — keep moving. 

Thomas Morton 
I think that 1 shall never see 
A poem lovely as a tree. 

Joyce Kilmer 



Under 

Constructi on 
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Outline 

22.1 Introduction 

22.2 Self-Referential Classes 

22.3 Linked Lists 

22.4 Stacks 

22.5 Queues 

22.6 Trees 

Summary • Terminology • Common Programming Errors • Good Programming Practices • Per- 
formance Tips • Portability Tip • Self-Review Exercises • Answers to Self-Review Exercises • Ex- 
ercises • Special Section: Building Your Own Compiler 


22.1 Introduction 

We have studied Python’s high-level data types such as lists, tuples and dictionaries. This 
chapter introduces the general topic of data structures that underlies Python’s basic data 
types. Linked lists are collections of data items “lined up in arow”—insertions and remov- 
als are made any where in a linked list. Stacks are important in compilers and operating Sys¬ 
tems—insertions and removals are made only at one end of a stack—its top. Queues 
represent waiting lines; insertions are made at the back (also referred to as the tail) of a 
queue, and removals are made from the front (also referred to as the head) of a queue. Bi¬ 
na ry trees facilitate high-speed searching and sorting of data, efficient elimination of du¬ 
plicate data items, representing file system directories and compiling expressions into 
machine language. These data structures have many other interesting applications. 

We will discuss the major types of data structures and implement programs that create 
and manipulate these data structures. We use classes and inheritance to create and package 
these data structures for reusability and maintainability. 

Although basic Python lists can serve as stacks and queues, studying this chapter and 
creating these structures “from scratch’’ is solid preparation for higher-level computer Sci¬ 
ence courses. The chapter examples are practical programs that you will be able to use in 
more advanced courses and in industry applications. The exercises include a rich collection 
of useful applications. 


22.2 Self-Referential Classes 

A self-referential class contains a reference member that refers to an instance of the same 
class type. Consider a class Node that has two data members—member data and refer¬ 
ence member nextNode. Member nextNode refers to an instance of class Node —an 
instance of the same class as the one being declared here, hence the term “self-referential 
class.” Member nextNode is referred to as a link —i.e., nextNode can be used to “tie” 
an instance of class Node to another instance of the same type. Class Node also has five 
methods: a constructor that receives a value to initialize member data, a setData meth- 
od to set the value of member data, a getData method to return the value of member 
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data, a setNextNode method to set the value of member nextNode and a getNext- 
Node method to return the value of member nextNode. 

Self-referential class objects can be linked together to form useful data structures such 
as lists, queues, stacks and trees. Figure 22.1 illustrates two self-referential class instances 
linked together to form a list. Note that a slash—representing a reference to None —is 
placed in the link member of the second self-referential class instance to indicate that the 
link does not refer to another instance. The slash is only for illustration purposes; it does 
not correspond to the backslash character in Python. A None reference normally indicates 
the end of a data structure. 



Fig. 22.1 Two self-referential class objects linked together. 

22.3 Linked Lists 

A linked list is a linear collection of self-referential class instances, called nodes, connected 
by reference links — hence, the term “linked” list. A linked list is accessed via a reference 
to the first node of the list. Subsequent nodes are accessed via the reference link stored in 
each node. By convention, the link in the last node of a list is set to None to mark the end 
of the list. Data are stored in a linked list dynamically—each node is created as necessary. 
A node can contain data of any type, including instances of other classes. Stacks and queues 
are also linear data structures and, as we will see, are constrained versions of linked lists. 
Trees are nonlinear data structures. 

Linked lists can be maintained in sorted order by inserting each new element at the 
proper point in the list. Existing list elements do not need to be moved. 

Performance Tip 22.1 

Insertion and deletion in a regular sorted list can be time-consuming—ali the elements fol- 
lowing the inserted or deleted element must be shifted appropriately. However, insertion and 
deletion in a sorted linked list requires only three changes to reference links (at most). 

Linked list nodes are normally not stored contiguously in memory. Logically, how¬ 
ever, the nodes of a linked list appear to be contiguous. Figure 22.2 illustrates a linked list 
with several nodes. 
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firstNode lastNode 



Fig, 22.2 A graphical representation of a list. 

The program of Figure 22.3 uses a List instance to manipulate a list of integer values. 
The driver program (f igl5_02 . py) provides five options: 

1. Insert a value at the beginning of the list (method insertAtFront). 

2. Insert a value at the end of the list (method insertAtBack). 

3. Delete a value from the front of the list (method removeFromFront). 

4. Delete a value from the end of the list (method removeFromBack). 

5. Terminate the list processing. 

A detailed discussion of the program follows. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 
29 


# Fig. 22.3: List.py 

# Classes List and Node definition 

class Node: 

def _ init_( self, data ): 

self.data = data 
self.nextNode = None 

def getData( self ): 

return self.data 
def setData( self, data ): 

self.data = data 
def getNextNode( self, ): 

return self.nextNode 
def setNextNode( self, newNode ): 


Fig. 22.3 Manipulating a linked list— List. py. 
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self.nextNode = newNode; 
class List: 


def _ init_( self ): 


self.firstNode = None 
self.lastNode = None 

def _ str_( self ): 


if self.isEmpty() : 

return The list is empty ’ 

currentNode = self.firstNode 
string = 

while currentNode is not None: 

string += str( currentNode.getData() ) + 
currentNode = currentNode.getNextNode() 

return string 

def insertAtFront ( self, value ): 


newNode = Node( value ) 
if self.isEmpty(): 

self.firstNode = self.lastNode = newNode 

else : 

newNode.setNextNode( self.firstNode ) 
self.firstNode = newNode 

def insertAtBack( self, value ): 


newNode = Node( value ) 
if self.isEmpty(): 

self.firstNode = self.lastNode = newNode 

else : 

self.lastNode.setNextNode( newNode ) 
self.lastNode = newNode 

def removeFromFront( self ) : 

"Delete node from front of list" 

if self.isEmpty(): 
raise IndexError, 


Fig. 22.3 Manipulating a linked list— List. py. 
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TZ -- 

firstNodeValue = self.firstNode.getData() 

86 

if self.firstNode is self.lastNode: 

self.firstNode = self.lastNode = None 

89 else: 

self.firstNode = self.firstNode.getNextNode() 

91 

92 return firstNodeValue 

93 

94 def removeFromBack( self ): 

95 "Delete node from back of list" 

96 

if self.isEmpty(): 

98 raise IndexError, 

99 

lastNodeValue = self.lastNode.getData() 

101 

if self.firstNode is self.lastNode: 

self.firstNode = self.lastNode = None 

104 else: 

105 currentNode = self.firstNode 

106 

while currentNode.getNextNode() is not self.lastNode: 
currentNode = currentNode.getNextNode() 

109 

110 currentNode.setNextNode( None ) 

111 self.lastNode = currentNode 

112 

113 return lastNodeValue 

114 

115 def isEmpty( self ) : 

116 

117 

118 return self.firstNode is None 


Fig. 22.3 Manipulating a linked list— List. py. 


119 

# Fig. 22.3: fig22_02.py 


120 

121 

# Driver to test class List 


122 

import sys 


123 

124 

from List import List 


125 

def instructions(): 


126 

127 



128 

print "Enter one of the followd 

, \ 

129 


, \ 

130 


, \ 

131 


, \ 

132 

133 


, \ 


Fig. 22.3 Manipulating a linked list— f ig22_03 . py. 
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173 


listObject = List() 

instructions() 

choice = raw_input( ) 

while choice != 

if choice == 

listObject.insertAtFront( raw_input( 
print listObject 
elif choice == 

listObject.insertAtBack( raw_input( 
print listObject 
elif choice == 

try : 

value = listObject.removeFromFront() 
except IndexError, message: 

print , message 

else: 

print value, 
print listObject 

elif choice == 

try: 

value = listObject.removeFromBack() 
except IndexError, message: 

print , message 

else : 

print value, 
print listObject 


else : 

print , choice 

choice = raw_input( ) 

print End list test\n" 


) ) 

) 


Fig. 22.3 Manipulating a linked list— f ig22_03 . py. 
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Figure 22.3 consists of two classes— Node and List. Encapsulated in each List 
object is a linked list of Node instances. Node member nextNode Stores a reference to 
the next Node instance in the linked list. 

The List class consists of members f irstNode (a reference to the First Node in a 
List instance) and lastNode (a reference to the last Node in a List instance). The 
constructor initializes both links to None. The primary methods of the List class are 
insertAtFront, insertAtBack, removeFromFront, and removeFromBack. 
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Method isEmpty is called a predicate method — it does not alter the List; rather, it 
determines if the List is empty (i.e., the reference to the first Node of the List is None). 

If the List is empty, 1 is returned; otherwise, 0 is returned. Method_ str _displays 

the List’s contents. 



Good Programming Practice 22.1 

Assign None to the link member of a new node. 



Because of Python reference counting. when no references to a List object exist, the 
List is destroyed, and ali Node instances the List referenced are destroyed (assuming 
there are no other references to them). However, in a language without reference counting 
or automatic garbage collection (such as C or C++), it is necessary to remove ali references 
to the se instances and destroy them manually (by a destructor, for example). 


Over the next several pages, we discuss each of the methods of the List class in 
detail. Method insertAtFront places a new node at the front of the list. The method 
consists of several steps: 

1. Create a new Node instance and store the reference in variable newNode. 

2. If the list is empty, then both f irstNode and lastNode are set to newNode. 

3. If the list is not empty, then the node referenced by newNode is threaded into the 
list by copying f irstNode to newNode . nextNode so that the new node re¬ 
fers to what used to be the first node of the list, and copying newNode to f irst¬ 
Node so that f irstNode now refers to the new first node of the list. 

Figure 22.4 illustrates method insertAtFront. Part a) of the figure shows the list 
and the new node before the insertAtFront operation. The dotted arrows in part b) 
illustrate the steps 2 and 3 of the insertAtFront operation that enable the node con- 
taining 12 to become the new list front. 
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a) 


firstNode 



newNode 



b) 


firstNode 


newNode 


■V 



Fig. 22.4 A graphical representation of the insertAtFront operation. 

Method insertAtBack places a new node at the back of the list. The method con- 
sists of several steps: 

1. Create a new list node that contains value and store the node in reference newN¬ 
ode. 

2. If the list is empty, then both firstNode and lastNode are set to newNode. 

3. If the list is not empty, then the node referenced by newNode is threaded into the 
list by copying newNode into lastNode . nextNode so that the new node is 
referred to by what used to be the last node of the list, and copying newNode to 
lastNode so that lastNode now points to the new last node of the list. 

Figure 22.5 illustrates an insertAtBack operation. Part a) of the figure shows the 
list and the new node before the operation. The dotted arrows in part b) illustrate the steps 
of method insertAtBack that enable a new node to be added to the end of a list that is 
not empty. 
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a) 


firstNode lastNode newNode 



b) 


firstNode 


lastNode newNode 



Fig. 22.5 A graphical representation of the insertAtBack operation. 

Method reraoveFromFront removes the front node of the list and retums the value 
in that node. The method raises an IndexError if an attempt is made to remove a node 
from an empty list. The method consists of several steps: 

1. If the list is empty, raise an IndexError. 

2. Assign the data from the firstNode to variable firstNodeValue. The 
method eventually returns this value. 

3. If firstNode is equal to lastNode, i.e., if the list has only one element prior 
to the removal attempt, then set firstNode and lastNode to None to de- 
thread that node from the list (leaving the list empty). 

4. If the list has more than one node prior to removal, then leave lastNode as is 
and set firstNode to firstNode . nextNode, i.e., modify firstNode to 

refer to what was the second node prior to removal (and is the new first node now). 

5. After ali these reference manipulations are complete, return f irstNodeValue, 
the data from the removed node. 

Figure 22.6 illustrates method removeFromFront. Part a) illustrates the list before 
the removal operation. Part b) shows actual reference manipulations. 
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a) 


firstNode 


lastNode 



b) firstNode lastNode 



tempNode 


Fig. 22.6 A graphical representation of the removeFromFront operation. 

Method removeFromBack removes the back node of the list and returns the value 
in that node. The method raises and IndexError if an attempt is made to remove a node 
from an empty list. The method consists of several steps: 

1. If the list is empty, raise an IndexError. 

2. Assign the data from the lastNode to variable lastNodeValue. The method 
eventually returns this value. 

3. If firstNode is equal to lastNode, i.e., if the list has only one element prior 
to the removal attempt, then set firstNode and lastNode to None to de- 
thread that node from the list (leaving the list empty). 

4. If the list has more than one node prior to removal, then assign currentNode 
the node to which firstNode refers. 

5. Now “walk the list” with currentNode until it refers to the node before the last 
node. This is done with a while loop that keeps replacing currentNode by 
currentNode . nextNode while currentNode . nextNode is not last¬ 
Node. 

6. Set the nextNode of currentNode to None and assign lastNode to cur¬ 
rentNode. 

7. After all these reference manipulations are complete, return lastNodeValue, 
the data from the removed node. 

Figure 22.7 illustrates method removeFromBack. Part a) of the figure illustrates the 
list before the removal operation. Part b) of the figure shows the actual reference manipu¬ 
lations. 
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b) firstNode c urren tNode lastNode 



tempNode 


Fig. 22.7 A graphical representation of the removeFromBack operation. 

Method_ str _first determines if the list is empty. If so, the method returns "The 

list is empty". Otherwise, it returns a string that contains each node’s data. The 
method initializes currentNode as a copy of firstNode and then initializes the string 
"The list is: ". While currentNode is not None, currentNode . data is added 
to the string and the value of currentNode . nextNode is assigned to currentNode. 
Note that if the link in the last node of the list is not None, the string creation algorithm 
will erroneously continue past the end of the list. The string creation algorithm is identical 
for linked lists, stacks and queues. 

The kind of linked list we have been discussing is a singly linked list —the list begins 
with a reference to the first node, and each node contains a reference to the next node “in 
sequence.” This list terminates with a node whose reference member is None. A singly 
linked list may be traversed in only one direction. 

A circular, singly linked list begins with a reference to the first node, and each node 
contains a reference to the next node. The “last node” does not contain a reference to None; 
rather, the reference in the last node refers back to the first node, thus closing the “circle.” 

A doubly linked list allows traversals both forwards and backwards. Such a list is often 
implemented with two “start references”—one that refers to the first element of the list to 
allow front-to-back traversal of the list, and one that refers to the last element of the list to 
allow back-to-front traversal of the list. Each node has both a forward reference to the next 
node in the list in the forward direction and a backward reference to the next node in the 
list in the backward direction. If the list contains an alphabetized telephone directory, for 
example, searching for someone whose name begins with a letter near the front of the 
alphabet might begin from the front of the list. Searching for someone whose name begins 
with a letter near the end of the alphabet might begin from the back of the list. 
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In a circular, doubly linked list, the forward reference of the last node refers to the first 
node, and the backward reference of the first node refers to the last node, thus closing the 
“circle.” 


22.4 Stacks 


A stack is a constrained version of a linked list—new nodes can be added to a stack and 
removed from a stack only at the top. For this reason, a stack is referred to as a last-in, first- 
out (L1FO) data structure. The link member in the last node of the stack is set to None to 
indicate the bottom of the stack. 


Common Programming Error 22.2 



Not setting the link in the bottom node ofa stack to None. 


The primary methods used to manipulate a stack are push and pop. Method push 
adds a new node to the top of the stack. Method pop removes a node from the top of the 
stack and retums the popped value to the caller. The method raises an IndexError if the 
stack is empty. 

Stacks have many interesting applications. For example, when a function call is made, 
the called function must know how to return to its caller, so the return address is pushed 
onto a stack. If a series of function calls occurs, the successive return values are pushed onto 
the stack in last-in, first-out order so that each function can return to its caller. Stacks sup- 
port recursive function calls in the same manner as conventional nonrecursive calls. 

Stacks contain the space created for local variables on each invocation of a function. 
When the function returns to its caller or throws an exception, the destructor (if any) for 
each local object is called, the space for that function’s local variables is popped off the 
stack and those variables are no longer known to the program. Stacks are used by compilers 
in the process of evaluating expressions and generating machine language code. The exer- 
cises explore several applications of stacks. 

We will take advantage of the close relationship between lists and stacks to implement 
a stack class primarily by reusing a list class. We implement the stack class through inher- 
itance of the list class. 

The program of Figure 22.8 creates a Stack class primarily through inheritance of 
class List of Fig. 22.3 We want the Stack to have methods push and pop. Note that 
these are essentially the insertAtFront and removeFromFront methods of class 
List. When we implement the Stack’s methods, we then have each of these call the 
appropriate method of class List—push calls insertAtFront, pop calls remove¬ 
FromFront. Of course, class List contains other methods (i.e., insertAtBack and 
removeFromBack) that we would not use when manipulating instances of class Stack. 
The driver program uses class Stack to instantiate a stack instance. Integers 0 through 3 
are pushed onto the stack and then popped off the stack. 


1 # Fig. 22.8: Stack.py 

2 # Class stack definition 

3 

Fig. 22.8 Simple stack implementation— Stack. py. 
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from List import List 

class Stack ( List ): 

def push ( self, data ) : 

self.insertAtFront( data ) 
def pop( self ): 

return self.removeFromFront() 


Fig. 22.8 Simple stack implementation— Stack. py. 


18 # Fig. 22.8: fig22_08.py 

19 # Driver to test class Stack 

20 

21 from Stack import Stack 

22 

23 stack = Stack() 

24 

25 print "processing a Stack" 

26 

27 for i in range( ): 

28 stack.push( i ) 
print stack 

30 

31 while not stack.isEmpty(): 

pop = stack.popO 
print pop, 

34 print stack 


Processing a Stack 
The list is: 0 
The list is: 10 
The list is: 2 1 0 
The list is: 3210 
3 popped from stack 
The list is: 2 1 0 
2 popped from stack 
The list is: 10 
1 popped from stack 
The list is: 0 
0 popped from stack 
The list is empty 


Fig. 22.8 Simple stack implementation— fig22_08 . py, 
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22.5 Queues 

A queue is similar to a supermarket checkout line—the first person in line is serviced first, 
and other customers enter the line at the end and wait to be serviced. Queue nodes are re- 
moved only from the head of the queue and are inserted only at the tail of the queue. For 
this reason, a queue is referred to as a first-in, first-out (FIFO) data structure. The insert and 
remove operations are known as enqueue and dequeue. 

Queues have many applications in computer systems. Most computers have only a 
single processor, so only one user at a time can be served. Entries for the other users are 
placed in a queue. Each entry gradually advances to the front of the queue as users receive 
Service. The entry at the front of the queue is the next to receive Service. 

Queues are also used to support print spooling. A multiuser environment may have 
only a single printer. Many users may be generating outputs to be printed. If the printer is 
busy, other outputs may stili be generated. These are “spooled” to disk (much as thread is 
wound onto a spool) where they wait in a queue until the printer becomes available. 

Information packets also wait in queues in computer networks. Each time a packet 
arrives at a network node, it must be routed to the next node on the network along the path 
to the packet’s final destination. The routing node routes one packet at a time, so additional 
packets are enqueued until the router can route them. 

A file server in a computer network handles file access requests from many clients 
throughout the network. Servers have a limited capacity to Service requests from clients. 
When that capacity is exceeded, client requests wait in queues. 

Figure 22.9 creates class Queue primarily through inheritance of class List of 
Fig. 22.3. We want the Queue to have methods enqueue and dequeue. We note that 
these are essentially the insertAtBack and removeFromFront methods of class 
List. When we implement the Queue’s methods, we have each of these call the appro- 
priate method of class List—enqueue calls insertAtBack and dequeue calls 
removeFromFront. Of course, class List contains other methods (i.e., insertAt- 
Front and removeFromBack) that we would not use when manipulating instances of 
class Queue. The main portion of the program uses class Queue to instantiate a queue 
instance. We enqueue integer values 0 through 3, then dequeue the values in first-in, first- 
out order. 


1 # Fig. 22.9: Queue.py 

2 # Class Queue definition 

3 

4 from List import List 

5 

6 class Queue ( List ) : 

7 

8 

def enqueue( self, data ): 

10 

11 

self.insertAtBack( data ) 

13 

14 def dequeue( self ) : 

Fig. 22.9 Simple queue implementation— Queue . py. 
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T5 - "Dequeue element" - 

16 

return self.removeFromFront() 


Fig. 22.9 Simple queue implementation— Queue . py. 


18 # Fig. 22.9: fig22_09.py 

19 # Driver to test class Queue 

20 

21 import Queue 

22 

23 queue = Queue.Queue() 

24 

25 print "Processing a Queue" 

26 

27 for i in range( ): 

queue.enqueue( i ) 
print queue 

30 

31 while not queue.isEmpty(): 

dequeue = queue.dequeue() 
33 print dequeue, 
print queue 


Processing 

a Queue 

The list is 

: 0 



The list is 

: 0 

1 


The list is 

: 0 

1 

2 

The list is 

: 0 

1 

2 3 

0 dequeued 




The list is 

: 1 

2 

3 

1 dequeued 




The list is 

: 2 

3 


2 dequeued 




The list is 

: 3 



3 dequeued 




The list is 

empty 


Fig. 22.9 Simple Queue implementation— fig22_0 9 . py, 


22.6 Trees 

Linked lists, stacks and queues are linear data structures. A tree is a nonlinear, two-dimen- 
sional data structure with special properties. Tree nodes contain two or more links. This 
section discusses binary trees (Fig. 22.10)—trees whose nodes all contain two links (one 
or both of which may be None). The root node is the First node in a tree. Each link in the 
root node refers to a child. The left child is the root node of the left subtree, and the right 
cliild is the root node of the right subtree. The children of a single node are called siblings. 
A node with no children is called a leafnode. Computer scientists normally draw trees from 
the root node down—exactly the opposite of trees in nature. 
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Fig. 22.10 A graphical representation of a binary tree. 


In this section, a special binary tree called a binary search tree (BST) is created. A 
binary search tree (with no duplicate node values) has the characteristic that the values in 
any left subtree are less than the value in its parent node, and the values in any right subtree 
are greater than the value in its parent node. Figure 22.11 illustrates a binary search tree 
with 12 values. Note that the shape of the binary search tree that corresponds to a set of data 
can vary, depending on the order in which the values are inserted into the tree. 


Common Programming Error 22.3 



Not setting the links in leaf nodes ofa tree to None. 


47 

25 

11 43 

7 17 31 44 

Fig. 22.11 Graphical representation of a binary search tree, 

The program of Figure 22.12 creates a binary search tree and traverses it (i.e., walks 
through ali its nodes) three ways—using recursive inorder, preorder and postorder tra- 
versals. 



1 # Fig. 22.12: Treenode.py 

2 # Treenode definition. 

3 

4 class Treenode: 

5 

6 def _ init_( self, data ): 

7 

8 

9 self.left = None 

Fig. 22.12 Implementing a binary tree— Treenode. py. 
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TTT 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 


self.data = data 

self.right = None 

def getData( self ): 

return self.data 
def setData( self, newData ): 

self.data = newData 
def getLeftNode( self ): 

return self.left 
def setLeftNode( self, node ): 

self.left = node 
def getRightNode( self ) : 

return self.right 
def setRightNode( self, node ): 

self.right = node 


Fig. 22.12 Implementing a binary tree— Treenode. py. 


42 # Fig. 22.12: Tree.py 

43 # Tree definition 

44 

45 from Treenode import Treenode 

46 

47 class Tree: 

48 iinary search tree 

49 

50 def _ init_( self ) : 

51 

52 

self.rootNode = None 

54 

55 def insertNode( self, value ): 

56 ' :nsert node into tree" 

57 

58 if self.rootNode is None: 

self.rootNode = Treenode( value ) 

Fig. 22.12 Implementing a binary tree—Tree. py, 
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95 

96 
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98 

99 

100 
101 
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103 

104 

105 

106 

107 

108 

109 

110 
111 
112 
113 


else : 

self.insertNodeHelper( self.rootNode, value ) 
def insertNodeHelper( self, node, value ): 


if value < node.getData(): 

if node.getLeftNode() is None: 

node.setLeftNode( Treenode( value ) ) 

else : 

self.insertNodeHelper ( node.getLeftNode(), value ) 

elif value > node.getData(): 

if node.getRightNode() is None: 

node.setRightNode( Treenode( value ) ) 

else : 

self.insertNodeHelper ( node.getRightNode(), value ) 

else : 

print value, 

def preOrderTraversal( self ) : 


self.preOrderHelper( self.rootNode ) 
def preOrderHelper( self, node ): 


if node is not None: 

print node.getData (), 

self.preOrderHelper( node.getLeftNode() ) 
self.preOrderHelper( node.getRightNode() ) 

def inOrderTraversal( self ): 


self.inOrderHelper( self.rootNode ) 
def inOrderHelper( self, node ): 


if node is not None: 

self.inOrderHelper( node.getLeftNode() ) 
print node.getData() , 

self.inOrderHelper( node.getRightNode() ) 
def postOrderTraversal( self ) : 


self.postOrderHelper( self.rootNode ) 


Fig. 22.12 Implementing a binary tree— Tree. py, 
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I 14 dt postOrderHelper( self, node ) : 

115 

116 

117 if node is not None: 

self.postOrderHelper( node.getLeftNode() ) 

self.postOrderHelper( node.getRightNode() ) 
120 print node.getData() , 


Fig. 22,12 Implementing a binary tree— Tree . py, 


121 # Fig. 22.12: fig22_12.py 

122 # The driver to test Tree class. 

123 

124 from Tree import Tree 

125 

126 tree = Tree() 

127 values = raw_input ( ) 

128 

129 for i in values.split () : 

130 tree.insertNode( int( i ) ) 

131 

132 print \nPreorder Traversal" 

133 tree.preOrderTraversal() 

134 print 

135 

136 print norder Traversal 

137 tree.inOrderTraversal() 

138 print 

139 

140 print "Postorder Traversal" 

141 tree.postOrderTraversal() 

142 print 


Enter 10 integer values: 


50 25 75 12 33 67 88 

6 

13 

68 

Preorder Traversal 

50 25 12 6 13 33 75 
Inorder Traversal 

67 

68 

88 

6 12 13 25 33 50 67 

Postorder Traversal 

68 

75 

88 

6 13 12 33 25 68 67 

88 

75 

50 


Fig. 22.12 Implementing a binary tree— fig22_12 .py. 


The main program begins by instantiating a binary tree. The program prompts for 10 
integers, each of which is inserted in the binary tree through a call to insertNode. The 
program then performs preorder, inorder and postorder traversals (these are explained 
shortly) of tree. 

Now we discuss the class definitions. Class TreeNode has as data the node’s data 
value, andreferences left (to the node’s left subtree) and right (to the node’s right sub- 
tree). The constructor sets member data to the value supplied as a constructor argument, 
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and sets references left and right to None (thus initializing this node to be a leaf node). 
Method getData returns the data value, and method setData sets the data value. 

Class Tree has data rootNode, a reference to the root node of the tree. The class has 
methods insertNode (that inserts a new node in the tree,) and preorderTraversal, 
inorderTraversal and postorderTraversal, each of which walks the tree in 
the designated manner. Each of these methods calls its own separate recursive utility 
method to perform the appropriate operations on the internal representation of the tree. The 
Tree constructor initializes rootNode to None to indicate that the tree is initially empty. 

The Tree class’ utility method insertNodeHelper recursively inserts a node into 
the tree. A node can only be inserted as a leaf node in a binary search tree. If the tree is 
empty, a new TreeNode is created, initialized and inserted in the tree. 

If the tree is not empty, the program compares the value to be inserted with the data 
value in the root node. If the insert value is smaller, the program recursively calls insert¬ 
NodeHelper to insert the value in the left subtree. If the insert value is larger, the program 
recursively calls insertNodeHelper to insert the value in the right subtree. If the value 
to be inserted is identical to the data value in the root node, the program prints the message 
"duplicate" and returns without inserting the duplicate value into the tree. 

Each of the methods inOrderTraversal, preOrderTraversal and pos- 
tOrderTraversal traverse the tree (Fig. 22.13) and print the node values. 

27 

13 42 

6 17 33^ 48 


Fig. 22.13 A binary search tree. 

The steps for an inorderTraversal are: 

1. Traverse the left subtree with an inorderTraversal. 

2. Process the value in the node (i.e., print the node value). 

3. Traverse the right subtree with an inorderTraversal. 

The value in a node is not processed until the values in its left subtree are processed. The 
inorderTraversal of the tree in Fig. 22.13 is: 

6 13 17 27 33 42 48 

Note that the inorderTraversal of a binary search tree prints the node values in 
ascending order. The process of creating a binary search tree actually sorts the data—and 
thus this process is called the binary tree sort. 

The steps for a preorderTraversal are: 

1. Process the value in the node. 

2. Traverse the left subtree with a preorderTraversal. 

3. Traverse the right subtree with a preorderTraversal. 
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The value in each node is processed as the node is visited. After the value in a given node 
is processed, the values in the left subtree are processed, and then the values in the right 
subtree are processed. The preOrderTraversal of the tree inFig. 22.13 is: 

27 13 6 17 42 33 48 

The steps for a postOrderTraversal are: 

1. Traverse the left subtree with a postOrderTraversal. 

2. Traverse the right subtree with a postOrderTraversal. 

3. Process the value in the node. 

The value in each node is not printed until the values of its children are printed. The pos¬ 
tOrderTraversal of the tree in Fig. 22.13 is: 

6 17 13 33 48 42 27 

The binary search tree facilitates duplicate elimination. As the tree is being created, an 
attempt to insert a duplicate value will be recognized because a duplicate will follow the 
same “go left” or “go right” decisions on each comparison as the original value did. Thus, 
the duplicate will eventually be compared with a node containing the same value. The 
duplicate value may be discarded at this point. 

Searching a binary tree for a value that matches a key value is fast. If the tree is bal- 
anced , then each level contains about twice as many elements as the previous level. So a 
binary search tree with n elements would have a maximum of log,« levels, and thus a max¬ 
imum of log,« comparisons would have to be made either to find a match or to determine 
that no match exists. This means, for example, that when searching a (balanced) 1000-ele- 
ment binary search tree, no more than 10 comparisons need to be made because 2 10 > 1000. 
When searching a (balanced) 1,000,000-element binary search tree, no more than 20 com¬ 
parisons need to be made because 2 20 > 1,000,000. 

In the exercises, algorithms are presented for several other binary tree operations such 
as deleting an item from a binary tree, printing a binary tree in a two-dimensional tree 
format and performing a level-order traversal of a binary tree. The level-order traversal of 
a binary tree visits the nodes of the tree row by row, starting at the root node level. On each 
level of the tree, the nodes are visited from left to right. Other binary tree exercises include 
allowing a binary search tree to contain duplicate values, inserting string values in a binary 
tree and determining how many levels are contained in a binary tree. 

SUMMARY 

• Self-referential classes contain members called links that point to objects of the same class type. 

• Self-referential classes enable many objects to be linked together in stacks, queues lists and trees. 

• A linked list is a linear collection of self-referential class objects. 

• A linked list is a dynamic data structure—the length of the list increases or decreases as necessary. 

• Linked lists can continue to grow until memory is exhausted. 

• Linked lists provide a mechanism for insertion and deletion of data by reference manipulation. 
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• A singly linked list begins with a link to the first node, and each node contains a link to the next 
node “in sequence.” This list terminates with a node whose reference mernber is None. A singly 
linked list may be traversed in only one direction. 

• A circular, singly linked list begins with a link to the first node, and each node contains a link to 
the next node. The link in the last node references the first node, thus closing the “circle.” 

• A doubly linked list allows traversals both forwards and backwards. Each node has both a forward 
link to the next node in the list in the forward direction, and a backward link to the next node in 
the list in the backward direction. 

• In a circular, doubly linked list, the forward link of the last node points to the first node, and the 
backward link of the first node points to the last node, thus closing the “circle.” 

• Stacks and queues are constrained versions of linked lists. 

• New stack nodes are added to a stack and are removed from a stack only at the top of the stack. 
For this reason, a stack is referred to as a last-in, first-out (LIFO) data structure. 

• The link member in the last node of the stack is set to null (zero) to indicate the bottom of the stack. 

• The two primary operations used to manipulate a stack are push and pop. The push operation 
creates a new node and places it on the top of the stack. The pop operation removes a node from 
the top of the stack and returns the popped value. 

• In a queue data structure, nodes are removed from the head and added to the tail. For this reason, 
a queue is referred to as a first-in, first-out (FIFO) data structure. The add and remove operations 
are known as enqueue and dequeue. 

• Trees are two-dimensional data structures requiring two or more links per node. 

• Binary trees contain two links per node. 

• The root node is the first node in the tree. 

• Each of the references in the root node refers to a child. The left child is the first node in the left 
subtree, and the right child is the first node in the right subtree. The children of a node are called 
siblings. Any tree node that does not have any children is called a leaf node. 

• A binary search tree has the characteristic that the value in the left child of a node is less than the 
value in its parent node, and the value in the right child of a node is greater than or equal to the 
value in its parent node. If there are no duplicate data values, the value in the right child is greater 
than the value in its parent node. 

• An inorder traversal of a binary tree traverses the left subtree inorder, processes the value in the 
root node and then traverses the right subtree inorder. The value in a node is not processed until 
the values in its left subtree are processed. 

• A preorder traversal processes the value in the root node, traverses the left subtree preorder and 
then traverses the right subtree preorder. The value in each node is processed as the node is en- 
countered. 

• A postorder traversal traverses the left subtree postorder, traverses the right subtree postorder then 
processes the value in the root node. The value in each node is not processed until the values in 
both its subtrees are processed. 

SUMMARY 

[***To be done for second round of review***] 

TERMINOLOGY 

[***To be done for second round of review***] 
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SELF-REVIEW EXERCISES 

[***To be done for second round of review***] 

ANSWERS TO SELF-REVIEW EXERCISES 

[***To be done for second round of review***] 

EXERCISES 

[***To be done for second round of review***] 
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Notes to Reviewers: 

• Please mark your comments in place on a paper copy of the chapter. 

• Please retum only marked pages to Deitel & Associates, Inc. 

• Please do not send e-mails with detailed, line-by-line comments; mark these directly on the paper 
pages. 

• Please feel free to send any lengthy additional comments by e-mail to 

ben.wiedermanngdeitel.net. 

• Please run ali the code examples. 

• Please check that we are using the correct programming idioms. 

• Please check that there are no inconsistencies, errors or omissions in the chapter discussions. 

• The manuscript is being copy edited by a professional copy editor in parallel with your reviews. 
That person will probably find most typos, spelling errors, grammatical errors, etc. 

• Please do not rewrite the manuscript. We are mostly concerned with technical correctness and cor¬ 
rect use of idiom. We will not make significant adjustments to our writing or coding style on a 
global scale. Please send us a short e-mail if you would like to make a suggestion. 

• If you find something incorrect, please show us how to correct it. 

• In the later round(s) of review, please read ali the back matter, including the exercises and any So¬ 
lutions we provide. 

• Please review the index we provide with each chapter to be sure we have covered the topics you 
feel are important. 

Additional Comments: 

• The goal of this chapter is to teach the concept of data structures. However, it would be a good 
idea to include more performance tips, throughout, to demonstrate why Python may or may not be 
the best language in which to actually implement these data structures. 

• Currently, we are reorganizing our object-oriented chapters to better capture the Python OOP idi¬ 
om (specifically, attribute access). The implications for this chapter are: 

1. "Private data" 

1. Access methods go away. 

2. We may be able to prevent access to un-needed base class methods from clients 
of a derived class? 
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[*** Notes to Reviewers ***] 

REVIEWERS: This chapter stili needs its treatment of wireless device programming. We 
are working on the section. but have chosen to send out this chapter without that segment 
and without the back matter—the summary terminology and exercises. When we imple- 
ment the wireless section and your comments from this first round of review, we are going 
to send this chapter in its entirety out for a second round of review. 


Please be sure to do each of the following items: 


1. Read the entire chapter. 

2. Please mark your comments in place on a paper copy of the chapter. 

3. Please return only marked pages to Deitel & Associates, Inc. 

4. The manuscript is being copyedited by a professional copy editor in parallel with 
your reviews. That person will probably find most typos, spelling errors, gram- 
matical errors, etc. 

5. Run each example. 

6. Comment on our example selection and implementation. 

7. Please check that there are no inconsistencies, errors or omissions in the chapter 
discussions. 

8. Watch for proper use of idioms. If there are improper uses, state explicitly how to 
correet them. 

9. Suggest other examples or features that should be covered (if necessary). 

10. Do we need additional line art or tables. If so, where are they needed and for what 
are they needed? 

11. Please do not rewrite the manuscript. We are concerned mostly with technical 
correctness and correct use of idiom. We will not make significant adjustments to 
our writing style on a global scale. Please send us a short e-mail if you would like 
to make such a suggestion. 

12. Please be constructive. This book will be published soon. We all want to published 
the best possible book. 

13. If you find something that is incorrect, please show us how to correct it. 

14. 13. Please review the index we provide with each chapter to be sure we have cov¬ 
ered the topies you feel are important. 
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Case Study: Online 
Bookstore 


Objectives 

• To build a three-tier, client/server, distributed Web 
application using Python and CGI. 

• To understand the concept of an HTTP session. 

• To be able to use a Session class to keep track of an 
HTTP session between pages. 

• To be able to create XML from a script and XSL 
transformations to convert the XML into a format the 
client can display. 

• To be able to deploy an application on an Apache Web 
server. 

[*** NEED QUOTES. ***] 

Under 

Constructi on 
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Chapter 23 


Outline 

23.1 Introduction 

23.2 HTTP Sessions and Session Tracking Technologies 

23.3 Tracking Sessions with Python Session Class 

23.4 Bookstore Architecture 

23.5 Setting up the Bookstore 

23.6 Entering the Bookstore 

23.7 Obtaining the Book List from the Database 

23.8 Viewing a Book’s Details 

23.9 Adding an Item to the Shopping Cart 

23.10 Viewing the Shopping Cart 

23.11 Checking Out 

23.12 Processing the Order 

23.13 Error Handling 

23.14 Handling Wireless Clients (XHTML Basic and WML) 

Summary • Terminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 


23.1 Introduction 

In this chapter, we implement a bookstore Web application that integrates many technolo- 
gies we cover in this book while serving as a capstone for our presentation of Python CGI. 
The technologies used in the application include CGI (Chapter 6), XML, XSL and XSLT 
(Chapters 15-16), mySQL and the Python DB-API (Chapter 17), HTML and XHTML 
(Chapters 26-27) and Cascading Style Sheets (Chapter 28). The case study also introduces 
additional features—we will discuss the new elements as we encounter them. We demon¬ 
strate how to deploy this application on an Apache server so that after reading this chapter, 
you will be able to implement a substantial distributed Web application containing many 
components on an Apache server. 


23.2 HTTP Sessions and Session Tracking Technologies 

Web sites that can provide custom Web pages and functionality tailored to clients viewing 
the content can implement e-commerce applications. One example of such a Web site ap¬ 
plication is the Online shopping cart we are building for this chapter’s Online bookstore case 
study. To enable this type of application, the server must distinguish between clients so the 
company can ship the ordered items and properly charge each client. Session-tmcking tech¬ 
nologies allow servers to distinguish between clients. In this section, we introduce and ex- 
plain cookies and session ID technologies and how they operate using Internet protocols. 

The Internet uses the HvperText Transfer Protocol (HTTP), a connectionless protocol. 
A connectionless protocol is one in which every request made from a Web browser to a 
server uses a new connection, and once a client request is processed, the connection termi- 
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nates. This means that the client must identify itself with each request while connecting to 
the server using HTTP. 

One session tracking method uses cookies. Cookies are small text files sent by a Python 
CGI script as part of a response to a client. Cookies can store information on the client’s 
computer for retrieval later in the same browsing session or in future browsing sessions. 
For example, because cookies can be retrieved later in the same session, cookies could be 
used in a shopping application to indicate the client's preferences because the cookies have 
traced the clients’ movements—which pages have been visited and what links have been 
clicked. When the Python script receives the client’s next communication, the Python script 
can examine the cookie(s) information and identify the client’s preferences and display 
products that may be of interest to the client, based the pages they have viewed. 

Every HTTP-based interaction between a client and a server includes a header that 
contains information about the request (communication from the client to the server) or 
information about the response (communication from the server to the client). When a 
Python script receives a request, the header includes information such as the request type 
(e.g., GET or POST) and cookies stored on the client machines by the server. When the 
server formulates its response, the header information includes any cookies the server will 
store on the client computer. 

Depending on the maximum age of a cookie, the Web browser either maintains the 
cookie for the duration of the browsing session (i.e., until the user closes the Web browser) 
or Stores the cookie on the client computer to access in a future session. When the browser 
makes a request of a server, cookies previously sent to the client by that server are returned 
to the server (if they have not expired) as part of the request formulated by the browser. 
Cookies are automatically deleted when they expire (i.e., reach their maximum age). 

Cookies often are the easiest way for a Python programmer to distinguish clients. 
However, cookies are not accepted by ali client types or browsers. Also, users may disable 
cookies, which may make users unable to view content on cookie-dependent sites—some 
sites require cookies for clients to even access horne pages. For these reasons, we have 
chosen not to use cookies to track sessions in our Online bookstore. 

Portability Tip 23.1 

Not ali browsers support cookies. Designing a server which uses cookies may exclude some 
users from accessing your site. 

Another method for session tracking involves embedding state information. The first 
time a client connects to a server, it is assigned a unique session ID by the server. When the 
client makes additional requests, the client’s session ID is compared against the session IDs 
stored on the server. 

The ID must be passed from page to page so each Web page file will know the session 
ID of the current client, thereby distinguishing clients. This can be done in different ways. 
One method of passing the ID is to place a hidden forni field. Then the next page can access 
the ID as a normal CGI parameter. Another method is to add the ID to the URL by adding 
the ID to a hyperlink that points to the next page. The next page can then extract the ID from 
the URL. If the ID is appended to the URL as part of a query string, however, the next page 
can access the ID as a normal CGI parameter. 

Although more extensible than cookies, tracking session information using embedded 
session IDs has disadvantages. One disadvantage to this method is that it creates Web page 
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addresses much longer than they normally would be when the session ID is embedded in 
every hyperlink. Embedding information also presents a potential security risk. Storing the 
session ID in the web page or URL creates the possibility that a person other than the user 
may see the ID and gain access to the user’s data. Nonetheless, we have chosen this method 
to track HTTP sessions in our online bookstore. 



Good Programming Practice 23.1 

Every session-tracking method has advanlages and disadvantages. Research and carefidly 
consider each technique before selecting onefor a site. 


23.3 Tracking Sessions with Python Session Class 

Before we begin executing Scripts, we are going to introduce the class we use to track ses¬ 
sions in our bookstore application. In this section, we will explain our use of the Session 
class defined in Session.py to track an HTTP session (Fig. 23.1). We discuss how a 
script can specify whether to create a new session when a script creates a Session object. 
If the script creates a new session, a new session ID is created and a new dictionary of ses¬ 
sion data is initialized. Otherwise, Session extracts the session ID from the query string 
and loads the session data for that ID. Session data is pickled and stored on the server. You 
will see class Session executed in Figure 23.6. 


1 

# Fig. 23.1: Session. 

py 


2 

# Contains a Session 

class that keeps track of an 

http session 

3 

# by assigning a session ID and pickling session 

information. 

4 




5 

import os 



6 

import re 



7 

import md5 



8 

import egi 



9 

import time 



10 

import urlparse 



11 

import os.path 



12 

import cPickle 



13 

from UserDict import 

UserDict 


14 




15 

def getClientType(): 



16 




17 




18 

if re.searchl 

, os.environ[ 

] ) : 

19 

return ( 

, ) 


20 

elif re.searchf 

, os.environ[ 

1 ) : 

21 

return ( 

, ) 


22 

elif re.search( 

/ 


23 

os.environ[ 

1 ): 


24 

return ( , 

) 


25 

else: 



26 

return ( 

, ) 


27 




28 

def getContentType(): 



29 





Fig. 23.1 Utility functions and Session class that track an http session, 
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49 

50 

51 

52 

53 

54 
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67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 
81 
82 
83 


try : 

file = open( getClientType()[ ] + ) 

except : 

raise SessionError( ) 

contentType = file.readO 
file.close() 
return contentType 

def redirect( URL ): 


print 

urlparse.ur1j oin( 
os.environ[ 


% \ 


+ os.environ[ 
1, URL ) 


class SessionError( Exception ): 


+ 


def _ init_( self, error ): 


self.error = error 
def _ str_( self ) : 


return self.error 
class Session( UserDict ) : 

def _ init_( self, createNew = ): 


# attempt to load previously created session 

if not createNew: 


# session ID is passed in query string 

queryString = egi.parse_qs( os.environ[ 


# no ID has been supplied in query string 

if not queryString.has_key( ): 

raise SessionError( ) 


self.sessionlD = queryString[ 
self.fileName = os.getcwdO + 
self.sessionlD 


1 [ 1 

+ \ 


# supplied ID is invalid 

if not self.sessionExists(): 

raise SessionError( ) 


1 ) 


Fig. 23.1 Utility functions and Session class that track an http session, 
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WT 

85 

86 

87 

88 

89 

90 

91 

92 

93 

94 

95 

96 

97 

98 

99 

100 
101 
102 

103 

104 

105 

106 

107 

108 

109 

110 
111 
112 

113 

114 

115 

116 

117 

118 

119 

120 
121 
122 

123 

124 

125 

126 

127 

128 

129 

130 

131 

132 

133 

134 

135 

136 


# load pickled session dictionary 

UserDict._init_( self, self.loadSession() ) 

# create new session 
else: 

self.sessionlD = self.generatelD() 
self. fileName = os.getcwdO + + \ 

self.sessionlD 

if self.sessionExists(): 

raise SessionError( ) 

UserDict._init_( self ) 

# add ID, agent type, content type and empty cary to data 

self.datat ] = self.sessionlD 

self.datat ], self.data[ ] = \ 

getClientType() 

self.datat ] = getContentType() 

self.data[ 1=0 

def sessionExists( self ): 


return os.path.exists( self.fileName ) 
def loadSessiont self ): 


if self.sessionExists(): 

sessionFile = open( self.fileName ) 
data = cPickle.loadt sessionFile ) 
sessionFile.close() 
return data 

def saveSessiont self ): 


sessionFile = openf self.fileName, ) 

cPickle.dumpt self.data, sessionFile ) 
sessionFile.close() 

def deleteSessiont self ): 


os.removet self.fileName ) 
def generatelD( self ): 


seed = str( time.timet) ) + os.environt ] + \ 

os.environt ] 

ID = md5.new( seed ) 


Fig. 23.1 Utility functions and Session class that track an http session, 
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\i/ return ID.hexdigest() 

Fig. 23.1 Utility functions and Session class that track an http session, 

When a Session object is created, createNew (the argument passed to the cont- 
structor) can be specified to a value other than 0 (the default) to create a new session. In this 
case, execution begins at line 79 with a call to method generatelD Method gener- 
atelD (lines 131-136) uses module md5 to generate a unique ID. Lines 134-135 create a 
string from the time of the session, the client address and the client port. Lines 136-137 
then create and return a unique ID using this string. For more information on md5, review 
Chapter 21. 

When the Session obtains its new ID from generatelD, it Stores the name of its 
session file, f ileName. and checks if the session already exists. Note that the filename of 
a session is a period (.) followed by the session ID. Ali session files are stored in a subdi- 
rectory, sessions, of the current working directory. If the session file already exists, 
Session raises the user-defined exception SessionError (line 82). 

Class Session inherits from class UserDict. UserDict is a class defined in 
module UserDict that simulates a dictionary. The contents of each instance are stored in 
a Python dictionary called data. Line 85 initializes an instance of UserDict, creating an 
empty session dictionary (data). Data then Stores the session ID (line 89). Lines 100-101 
obtain the client type from function getClientType and store it in the session dictio¬ 
nary. Function getClientType searches the HTTP_USER_AGENT environment vari- 
able for certain keywords to determine the client type (lines 15-26). Line 91 Stores the 
results of function getContentType in data. Function getContentType opens the 
contentType. txt file, which resides in a subdirectory named after the client type, and 
returns the contents of the file (lines 25-35). Figure 23.2 contains an example of such a file. 
Line 96 creates an empty shopping cart (an empty dictionary). 


1 Content-type: text/html 

2 


Fig. 23.2 contentType.txt for html clients. 

To save session data between pages, method saveSession must be called (lines 
119-124). This method creates a new session file corresponding to the value of attribute 
f ileName. Line 123 uses module cPickle to pickle the session dictionary and dump it 
into the session file. 

To open an existing session from a different script, create a Session with creat¬ 
eNew set to 0 (default). If createNew is 0, execution begins in line 67. Session obtains 
the query string and parses it. If no ID is specified, the constructor raises a Session¬ 
Error. Otherwise, the session ID is extracted and the filename is determined (lines 76- 
78). If the session does not exist, the constructor raises a SessionError (lines 81-82). 
Otherwise, the constructor calls the UserDict base-class constructor (line 85). The value 
of the session dictionary (data) is the value returned from method loadSession. This 
method (lines 110-117) opens the session file (line 114). It then uses cPickle to unpickle 
and return the session dictionary it contains (lines 115-117). 
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When a session is no longer needed, it can be removed from the server by invoking 
method deleteSession (line 126-129). This method deletes the session file by calling 

os.remove. 

23.4 Bookstore Architecture 

This section overviews the architecture of the bookstore application. We present a diagram 
of the basic interactions between Python Scripts, and a table of the files used in the case 
study. 

The shopping cart case study consists of a series of Python Scripts that internet to sim¬ 
ulate an online bookstore selling Deitel publications. This case study is implemented as a 
distributed, three-tier, Web-based application. The client tier is represented by the user’s 
Web browser. The browser displays either static or dynamically created documents that 
allow the user to internet with the server tier. These documents are created based upon the 
user’s client type. The server tier consists of several Scripts that act on behalf of the client. 
These Scripts perform tasks such as creating a list of publications, creating documents con- 
taining the details about a publication, adding items to the shopping cart, viewing the shop¬ 
ping cart and processing the final order. 



Fig. 23.3 Bug2Bug. com bookstore component interactions. 

Figure 23.3 illustrates the interactions between the bookstore’s application compo- 
nents. After creating a Session for the user, the user will be forwarded to all- 
Books .py a script that interacts with a database to create the list of books dynamically. 
The database tier uses the books database. The resuit is an XML document that represents 
the list of books. This XML document is then processed against a client-specific XSLT 
stylesheet to produce a page containing links to displayBook. This script receives as a 
parameter the ISBN number of the selected book and uses the ISBN to retrieve the book 
data and produce XML that represents the selected book. This XML is then processed 
against a different client-specific XSLT stylesheet to produce a document containing the 
information for that book. From this document, the user can use GUI components (in this 
case, buttons) to place the current book in the shopping cart or view the shopping cart. 

Adding a book to a shopping cart invokes addToCart. Viewing the cart contents 
invokes viewCart which returns a client-specific document (again, created by processing 
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XML with XSLT) containing the cart contents, the subtotal dollar cost of each item and the 
total dollar cost of all the items in the cart. When the user adds an item to the shopping cart, 
the addToCart script processes the user’s request, then forwards the request to view- 
Cart to create the document that displays the current cart. At this point, the user can either 
continue shopping (allBooks .py) or proceed to checkout (order.py). In the latter 
case, the user is presented with a form to input name, address and credit-card information. 
Then, the user submits the form to invoke process. py, which completes the transaction 
by sending a confirmation document to the user. Figure 23.4 overviews the Scripts and 
other files used in this case study. 


File 

Descriptiori 

Session.py 

Contains the Session class. An instance of this class keeps 
track of an HTTP session by assigning each user a unique ses¬ 
sion ID and pickling a dictionary of data for each ID. It also 
contains three utility functions for redirecting the client, deter- 
mining the user’s client type and determining the clienfs con- 
tent type (stored in contentType.txt). 

contentType.txt 

Contains the line that specifies to the browser the content type 
of the data. There is one of these files for each client type. 

bookstore.py 

This is the default home page for the bookstore, which is dis- 
played by entering the following URL in the client’s Web 
browser: 


http: / /localhost/cgi-bin/bookstore/ 
bookstore.py 


Here, a new Session is created for the user to track the 

HTTP session. The user is then forwarded to allBooks .py. 

styles.css 

This Cascading Style Sheet (CSS) file is linked to all XHTML 
and XHTML Basic documents rendered on the client. The CSS 
file allows us to apply uniform formatting across all the static 
and dynamic documents rendered. 

allBooks.py 

This script uses Book objects to create a document containing 
the product list. It queries the catalog database to obtain the 
list of tities in the database. The results are processed and 
placed into a list of Book objects. The list is stored as a session 
attribute for the client. The script creates an XML document 
which represents all the books, then applies a client-specific 
XSLT transformation (allBooks .xsl) to the XML to pro¬ 
duce a document that can be rendered by the client. 

allBooks.xsl 

This XSLT style sheet transforms the XML representation of 
the entire catalog of books into a document that the client 
browser can render. There is one of these files for each client 
type. 


Fig. 23.4 Components for bookstore case study (part 1 of 3). 
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File 

Descriptiori 

Book.py 

Contains the Book class. An instance of this class represents 
the data for one book. The Book’s getXML method retums an 
XML Element that represents the book. 

displayBook.py 

This script obtains the XML representation of a book selected 
by the user, then applies a client-specific XSLT transformation 
(displayBook.xsl) to the XML to produce a document 
that can be rendered by diverse clients. 

displayBook.xsl 

This XSLT style sheet transforms the XML representation of a 
book into a document that the client browser can render. There 
is one of these files for each client type. 

Cartltem.py 

Contains the Cartltem class. An instance of this class main- 
tains a Book and the current quantity for that book in the shop- 
ping cart. Cartltems are stored in a dictionary that 
represents the shopping cart contents. 

addToCart.py 

This script updates the shopping cart. If a Cartltem for the 
item is already in the cart, the script updates the quantity of 
that item in the class. Otherwise, the script creates a new Car¬ 
tltem with a quantity of 1. After updating the cart, the user is 
forwarded to viewCart .py to view the current cart contents. 

viewCart.py 

This script extracts the Cartltems from the shopping cart, 
subtotals each item in the cart, totals ali the items in the cart 
and creates an XML document that represents ali items in the 
cart. The script then applies a client-specific XSLT transforma¬ 
tion (viewCart .xsl) to the XML to produce a document 
that can be rendered by the client. This process allows the cli¬ 
ent to view the cart in tabular form. 

viewCart.xsl 

This XSLT style sheet transforms the XML representation of 
all of the Cartltems in the cart into a document that the cli¬ 
ent browser can render. There is one of these files for each cli¬ 
ent type. 

order.py 

When viewing the cart, the user can click a Check Out button 
to execute this script. This script displays a client-specific 
order form. In this example, the form has no functionality. 
However, it is provided to help complete the application. 

orderForm.html , 

orderForm.wml 

This static document contains an order form. It is displayed by 

order .py. 

process.py 

This final script pretends to process the user’s credit-card 
information and loads a client-specific document indicating 
that the order was processed and the total order value. 

thankYou.html, 

thankY ou.wml 

This static document, displayed by process .py, contains a 
message that the order was processed and the total order value. 


Fig. 23.4 Components for bookstore case study (part 2 of 3). 
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File Descriptiori 

error. py This script executes when an error occurs. It creates an XML 

document which represents the error. It then processes the 
XML against aclient-specific XSLT style sheet (error.xsl) 
to produce a document that can be rendered by the client. This 
document indicates to the user the error that occurred. 
error. xsl This XSLT style sheet transforms the XML representation of 

ali of an error into a document that the client browser can ren- 
der. There is one of these files for each client type. 


Fig. 23.4 Components for bookstore case study (part 3 of 3). 

23.5 Setting up the Bookstore 

All bookstore files are located in the Chapter 23 folder of the CD that accompanies this 
book. To set up the bookstore on your Web server, first copy subfolder bookstore and 
its contents into your server’s root directory (i.e., htdocs for Apache). Next, copy the 
contents of subfolder cgi-bin (subfolder bookstore) into your Web server’s cgi-bin. 
Finally, restart your Web server. Figure 23.5 illustrates the directory structure for Apache. 




Fig. 23.5 Apache directory structure 
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23.6 Entering the Bookstore 

Figure 23.6 (bookstore .py) is the default home page for the bookstore. It is the only 
way to enter the bookstore. When the site is running on Apache on your computer, enter 
the following URL in your Web browser to enter the bookstore: 

http://localhost/cgi-bin/bookstore/bookstore.py 


1 #!c: \Python\python .exe 

2 # Fig. 23.5: bookstore.py 

3 # Create a new Session for Client. 

4 

5 import sys 

6 import time 

7 import Session 

8 

9 # create new Session 


10 

try: 




11 

session = Session.Session( 

) 



12 

except Session.SessionError, 

message: 

# 

ID already exists 

13 

time.sleep( ) 


# 

wait 1 second 

14 

Session.redirect( 

) 

# 

try again 

15 

sys.exit() 




16 





17 

# re-direct to allBooks.py 




18 

nextPage = 

% sessioni 

1 

19 

session.saveSession() 




20 

Session.redirect( nextPage ) 





Fig. 23.6 Bookstore home page (bookstore. py). 

Line 11 creates a new Session for the client (see Section 11.2). Recall that if the ses- 
sion-generated ID already exists, a SessionError is raised. In this case, the program 
sleeps for one second (so that the seed for md5 changes), redirects the client to book¬ 
store .py (to make another attempt) and exits (lines 13-15). Otherwise, lines 18-20 are 
executed. Line 18 creates the redirection string to send the client to allBooks .py. Note 
that the session ID is stored in the URL as part of the query string. This ensures all¬ 
Books .py can determine the clienfs identity. Lines 19-20 save the session and print the 
redirection string, sending the client to allBooks .py. 


23.7 Obtaining the Book List from the Database 

We must first create a representation for a single book before we can obtain a list of books 
(Fig. 23.7). An instance of the Book class represents the properties for one book, including 
the book’s ISBN, title, Copyright, cover image file name, edition number, publisher ID 
number and price although some of this information is not used in this example. Each prop- 
erty is a read/write property. Book method getXML returns an XML Element represent- 
ing the book. 
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21 
22 

23 
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29 
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31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 


# Fig. 23.6: Book.py 

# Represents one book. 

class Book: 

def setISBN( self, isbn ): 

self.ISBN = isbn 
def getISBN( self ): 

return self.ISBN 
def setTitle( self, bookTitle ): 

self.title = bookTitle 
def getTitle( self ): 

return self.title 
def setCopyright( self, year ): 

self.Copyright = year 
def getCopyright( self ): 

return self.Copyright 
def setlmageFile( self, filename ): 

self.imageFile = filename 
def getImageFile( self ): 

return self.imageFile 
def setEditionNumber( self, edition ): 

self.editionNumber = edition 


Fig. 23.7 Book that represents a single book's information and detines the XML 
format of that information (part 1 of 3). 
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""52 def getEditionNumber( self ): 

53 

54 

55 return self.editionNumber 

56 

57 def setPublisherID( self, id ): 

58 """Set publisher ID number—" 

59 

60 self.publisherlD = id 

61 

62 def getPublisherID( self ): 

63 "■■"Return publisher ID number'"'" 

64 

65 return self.publisherlD 

66 

67 def setPrice( self, amount ): 

68 
69 

self.price = amount 

71 

def getPrice( self ): 

73 

74 

75 return self.price 

76 

def getXML( self, document ): 

78 """Return an XML representation of the product"'■ " 

79 

80 # create product node 

product = document.createElement( ) 

82 

83 # create isbn element, append as child of product 

temp = document.createElement( ) 

85 temp.appendChild( 

86 document.createTextNode( self.getISBN() ) ) 

87 product.appendChild( temp ) 

88 

89 # create title element, append as child of product 

temp = document.createElement( ) 

temp.appendChild( document.createTextNode( 
self .getTitleO ) ) 

93 product.appendChild( temp ) 

94 

95 # create price element, append as child of product 

temp = document.createElement( ) 

temp.appendChild( document.createTextNode( 

98 self .getPriceO ) ) 

product.appendChild( temp ) 

100 

101 # create imageFile element, append as child of product 

temp = document.createElement( ) 

temp.appendChild( document.createTextNode( 

104 self.getImageFile() ) ) 

Fig. 23.7 Book that represents a single book's information and detines the XML 
format of that information (part 2 of 3). 
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T05 " product.appendChild( temp ) 

106 

107 # create Copyright element, append as child of product 

temp = document.createElement( ) 

temp.appendChild( document.createTextNode( 

110 self.getCopyright() ) ) 

111 product.appendChild( temp ) 

112 

113 # create publisherlD element, append as child of product 

temp = document.createElement( ) 

temp.appendChild( document.createTextNode( 

116 self.getPublisherlD() ) ) 

117 product.appendChild( temp ) 

118 

119 # create editionNumber element, append as child of product 

temp = document.createElement( ) 

temp.appendChild( document.createTextNode( 
self.getEditionNumber() ) ) 

123 product.appendChild( temp ) 

124 

125 return product 


Fig. 23.7 Book that represents a single book's information and defines the XML 
format of that information (part 3 of 3). 

Method getXML (lines 77-124) uses the DOM Document and Element interfaces 
to create an XML representation of the book data as part of the Document that is passed 
as an argument to the method. The complete information for one book is placed in a 
product element (created in line 81). The elements for the individual properties of a book 
are appended to the product element as children. For example, line 84 uses Document 
method createElement to create element isbn. Line 85 uses Document method 
createTextNode to specify the text in the isbn element, and uses Element method 
appendChild to append the text to element isbn. Then, line 86 appends element isbn 
as a child of element product with Element method appendChild. Similar opera- 
tions are performed for the other book properties. Line 124 returns element product to 
the caller. For more information about XML and Python, refer to Chapters 15 and 16. 

Recall that after creating a session for the client, bookstore .py redirects the user 
to allBooks .py, This program retrieves the list of books from the catalog database 
and dynamically generates an XML document that represents it. This document is then pro- 
cessed against a client-specific XSLT stylesheet called allBooks .xsl. The results are 
then rendered on the client. 


1 #!c:\Python\python.exe 

2 # Fig. 23.7: allBooks.py 

3 # Retrieve all books from database and store in session. 

4 # Display book list to client by retrieving XML and converting 

5 # to required format using client-specific XSLT stylesheet. 

6 

7 import sys 

Fig. 23.8 allBooks .py returns to the client a document containing the book list 
(part 1 of 3), 
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8 import Book 

9 import Session 

10 import MySQLdb 

11 from xml.xslt import Processor 

12 from xml.dom.DOMImplementation import implementation 

13 

14 # load Session 

15 try: 

session = Session.Session() 

17 except Session.SessionError, message: 

18 Session.redirect( 
sys.exit() 

20 

21 # setup mySQL statement 

22 query = 

23 copyRight, publisherlD, imageFile, 

24 FROM tities ORDER BY title"' 

25 

26 # attempt database connection and retrieve list of Books 

27 try: 

28 

29 # connect to the database, retrieve a cursor and execute query 

30 connection = MySQLdb.connect( db = ) 

31 cursor = connection.cursor() 
cursor.execute( query ) 

33 

34 # acquire results and close database connection 

results = cursor.fetchall() 

36 cursor.close() 

37 connection.close() 

38 except OperationalError, message: 

39 Session.redirect( % message ) 

40 sys.exitO 

41 

42 allBooks = [] 

43 

44 # Get row data 

45 for row in results: 

46 book = Book.Book() 

47 book.setISBN( row[ ] ) 

48 book.setTitle( row[ ] ) 

49 book.setEditionNumber( str( row[ ] ) ) 

50 book.setCopyright( row[ ] ) 

51 book.setPublisherID( str( row[ ] ) ) 

book.setlmageFile( row[ ] ) 

53 book.setPrice( str( row[ ] ) ) 

54 

55 allBooks.append( book ) 

56 

57 session[ ] = allBooks 

58 

59 # genereate XML 

60 document = implementation.createDocument( None, None, None ) 

Fig. 23.8 allBooks .py returnsto the Client a document containing the book list 
(part 2 of 3), 
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catalog = document.createElement( ) 

62 document.appendchild( catalog ) 

63 

64 # add all products to catalog 

65 for book in allBooks: 

catalog.appendchild( book.getXML( document ) ) 

67 

68 # process XML against XSLT stylesheet 

69 processor = Processor.Processor() 

70 style = open( sessioni ] + ) 

71 processor.appendStylesheetString( style.read() % sessioni ] ) 

72 results = processor.runNode( document ) 

73 style.close() 

74 

75 # display content type and processed XML 

76 pageData = sessioni ] + results 

77 session.saveSession() 

78 print pageData 


Fig, 23.8 allBooks .py returnsto the Client a document containing the book list 
(part 3 of 3), 

Lines 15-19 load the session. If the session ID is not specified in the query string or if 
the specified ID is invalid, the user is redirected to the error message that displays in 

error.py. 

Lines 22-24 prepare the niySQL statement that allBooks uses to query the cat¬ 
alog database. Lines 30-37 then connect to the database and retrieve the list of books. If 
an error occurs, the user is redirected to error. py and the program exits (lines 39-40). 

Lines 45-55 create a Book object is created for each book in the database, its attributes 
are set and appended to list allBooks (lines 45-55). Note that the edition number, pub- 
lisher ID, and price attributes must first be converted to strings. This is because the values 
are stored as integer and float values in the database; however, each Book’s getXML 
method creates a TextNode for each of these attributes and createTextNode only 
accepts strings. Line 57 Stores the list of Book objects in the session dictionary with key 
tities. 

We then create an XML Document representing the entire catalog of books. Line 60 
uses the createDocument method of xml. dom.DOMImplementation. imple- 
mentation to create a blank DOM Document called document. Document method 
createElement creates the catalog element (line 61). Line 62 appends the cat¬ 
alog element to document. Lines 65-66 retrieve the product element for each book 
and use method appendchild to append the element to catalog. 

A client-specific XSLT stylesheet processes the XML Document (lines 69-73). An 
XSLT Processor is created (line 69) and retrieves the XSLT stylesheet called all¬ 
Books .xsl (line 70). Note that the copy of allBooks .xsl opened is the one found in 
the directory named after the client type. This ensures that the XSLT stylesheet will trans- 
form our XML Document into a format that is accepted by various clients. Line 71 
appends the stylesheet to the list of stylesheets the processor may use. The session ID must 
be inserted into the stylesheet first, because the ID is not contained in the XML Document 
that the stylesheet will transform. Lines 72-73 run the processor on document and close 
the stylesheet file, respectively. We then display the transformed XML to the client. Line 
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76 creates the string that contains the content type specificatiori and the processor results. 
Lines 77 and 78 save the session and display the page to the user. 

Figure 23.9 contains the XSLT stylesheet used to transform the XML catalog repre- 
sentation into XHTML. The resulting XFITML document is shown in the screen capture in 
ofFig. 23.9. 
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<?xml version = . 0 ?> 

<!-- Fig. 23.8: allBooks.xsl --> 

< !— XSLT stylesheet that transforms XML generated by --> 
<!-- books.py into XHTML. --> 

<xsl:stylesheet version = "1.0" 

xmlns:xsl = "http://www.w3.org/1999/XSL/Transform"> 

<xsl:output method = "xr omit-xml-declaration = 

indent = "yes" doctype-system = "DTD/xhtmll-strict-dt 
doctype-public = "-//W3C//DTD XHTML 1.0 Striet/ /EN" /> 

<!— template for catalog element --> 

<xsl:template mateh = 'catalog" > 

<html xmlns = "http://www.w3.org/1999/xhtml" 

xml:lang = lang = > 


<head> 

<title>Book List</title> 
<link rei = 

type = /> 

</head> 


href = 



<body> 


<p class = >Available Books</p> 

<p class = >Click a link to view book information</p> 


<!-- mateh product elements to product template --> 
<xsl:apply-templates select = " /catalog/prodt > 

<!-- sort products by title --> 

<xsl:sort select = title"/> 


</xsl:apply-templates> 

</body> 

</html> 

</xsl:template> 

<!— template for building row of Product information --> 

<xsl:template mateh = roduct > 

<a href = "displayBook.py?ID=%sScamp;isbn={isbn} "> 

<strongxxsl:value-of select = />, <xsl:value-of 


Fig. 23.9 allBooks .xsl for an HTML Client type which transforms the XML 
representation of the catalog into XHTML. 
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"35 select = — — />e</strong> 

47 </axbr/> 

48 

49 </xsl:template> 

50 </xsl:stylesheet> 




Fig. 23.9 allBooks .xsl for an HTML client type which transforms the XML 
representation of the catalog into XHTML. 

An xsl: template defines catalog elements (lines 13-38). Within this template, 
we insert any matches of the product template (lines 29-34). These matches are sorted 
by their title element (line 32). This ensures the book list appears in alphabetical order 
by the title name when it generates. 

Lines 42—49 define an xsl: template for elements named product. Line 44 spec- 
ifies a anchor tag with attribute href . The value of the href attribute is specified to be 
a reference to displayBook.py with a query string containing the session ID and the 
value of the isbn element of an XML document (accessed by {isbn}). This ensures that 
displayBook will be able to identify the client as well as the book to display. The anchor 
tag contains text and the values of the title and edition elements of an XML docu¬ 
ment (lines 45^-6 

The XSL document specifies a linked style sheet styles.css (Fig. 23.10). All 
XF1TML documents sent to the client use this style sheet, so that uniform formatting can be 
applied to the documents. Lines 1-2 indicate that all text in the body element should be 
centered and that the background color of the body should be Steel blue. The background 
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color is represented by the hexadecimal number #b0c4de. Line 3 defines class . bold to 
apply bold font weight to text. Lines 4-7 define class . bigFont with four CSS attributes. 
Elements to which this class is applied appear in the bold, Helvetica font which is double 
the size of the base-text font. The color of the font is dark blue (represented by the hexa¬ 
decimal number #00008b). If Helvetica font is not available. the browser will attempt to 
use Arial, then the generic font sans-serif as a last resort. Class .italic applies 
italic font style to text (line 8). Class . right right justifies text (line 9). Lines 10-11 indi¬ 
cate that all table, th (table head data) and td (table data) elements should have a three- 
pixel. grooved border with five pixels of internal padding between the text in a table cell 
and the border of that cell. Lines 12-14 indicate that all table elements should have bright 
blue background color (represented by the hexadecimal number #6495ed), and that all 
table elements should use automatically determined margins on both their left and right 
sides. This causes the table to be centered on the page. Not all of these styles are used in 
every XHTML document. However, using a single linked style sheet allows us to change 
the look and feel of our store quickly and easily by modifying the CSS file. For more Infor¬ 
mation on CSS see Chapter 28. 

ntrn Portc 

m Different browsers have different levels of support for Cascading Style Sheets. 


1 

body 

{ text-align: ; 

2 


background-color: > 

3 

.bold 

{ font-weight: } 

4 

.bigFont 

{ font-family: , , ; 

5 


font-weight: ; 

6 


font-size: ; 

7 


color: > 

8 

.italic 

{ font-style: } 

9 

.right 

{ text-align: } 

10 

table, th, td { border: ; 

11 


padding : } 

12 

table 

{ background-color: ; 

13 


margin-left: ; 

14 


margin-right : } 


Fig. 23.10 Shared cascading style sheet (styles .css) used to apply common 
formatting across XHTML documents rendered on the Client. 


23.8 Viewing a Book’s Details 

Selecting a book in allBooks .py forwards the user to displayBook.py. This pro- 
gram extracts the ISBN from the query string determines what book the user has selected 
by. It then obtains the XML representation of the book and processes it against a client-spe- 
cific XSLT stylsheet (displayBook.xsl). The results are sent to the user. 


1 #!c: \Python\python. exe 

Fig. 23.11 displayBook.pyconvertstheXMLrepresentationofthe selected book 
to a client-specific format using an XSLT stylesheet (part 1 of 3). 
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# Fig. 23.10: displayBook.py 

# Retrieve one book's XML representation, convert 

# to reguired format using client-specific XSLT 

# stylesheet and display results. 

import egi 
import sys 
import Session 

from xml.xslt import Processor 

from xml.dom.DOMImplementation import implementation 
form = cgi.FieldStorageO 

# ISBN has not been specified 

if not form.has_key( ): 

Session.redirect( ) 

sys.exit() 

# load Session 
try: 

session = Session.Session() 
except Session.SessionError, message: 

Session.redirect( 
sys.exit() 

tities = sessioni ] 

session[ 1 = None 

# locate Book object for selected book 

for book in tities: 

if form[ ].value == book.getISBN(): 

sessioni 1 = book 

break 

# book has been found 

if sessioni 1 is not None: 

# get XML from selected book 

document = implementation.createDocument( None, None, None ) 
document.appendChild( sessioni ].getXML( 

document ) ) 

# process XML against XSLT stylesheet 

processor = Processor.Processor() 

style = open( sessioni 1 + ) 

processor.appendStylesheetString( style.read() % \ 

( sessioni 1» sessioni ] ) ) 

results = processor.runNode( document ) 
style.close() 

# display content type and processed XML 

print sessioni 1 + results 


# invalid/no session ID 

% message ) 


Fig. 23.11 displayBook.pyconvertstheXMLrepresentationofthe selected book 
to a client-specific format using an XSLT stylesheet (part 2 of 3). 


© Copyright 1992-2002 by Deitel & Associates, Inc. AII Rights Reserved. 8/31/01 

































pythonhtpl_23.fm Page 1034 Friday, August 31, 2001 1:47 PM 


1034 Case Study: Online Bookstore 


Chapter 23 


55 

56 

57 

session.saveSession() 

else : 

# save Session data 


58 

# invalid ISBN has been 

specified 


59 

Session.redirect( 

r.py?message=Nonexistant+3 

) 


Fig. 23.11 displayBook.pyconvertstheXMLrepresentationoftheselectedbook 
to a client-specific format using an XSLT stylesheet (part 3 of 3). 


If the ISBN has not been specified, the user is forwarded to error. py (line 17). Oth- 
erwise, displayBook loads the session. If successful, displayBook obtains the list of 
Books from variable session (line 27). Line 28 sets the session dictionary key 
bookToAdd to value None, indicating that the specified ISBN has not yet been found in 
the list of Books stored in variable tities. 

Lines 31-35 iterate over tities, searching for a Book with the correct ISBN (spec¬ 
ified in the query string). If a book is found that has the specified ISBN, session attribute 
bookToAdd is set to the matching Book object and the loop terminates. 

Line 38 checks whether a matching book has been found. If not, the user is redirected 
to error .py (line 59). Otherwise, lines 41-55 execute. Line 41 creates anew XML Doc- 
ument. Lines 42-43 append the product element of the matching Book to the Docu- 
ment. using the appendChild method. Lines 46-51 process the XML Document 
against a client-specific XSLT stylesheet called displayBook.xsl. The correct 
stylesheet resides in the subfolder of the current directory named after the client type. Note 
that we must format the stylesheet, inserting the session ID, before processing. We then dis- 
play the results to the client and save the session (lines 54-55). 

Figure 23.12 contains the displayBook.xsl style sheet file used in the XSLT 
transformation. The values of six elements in the XML document are placed in the resulting 
XHTML document. The resulting XHTML document is shown in the screen capture at the 
end of Fig. 23.12. 


1 <?xml version = ?> 

2 <!— Fig. 23.11: displayBook.xsl 

3 <!— XSLT stylesheet that transforms XML generated by 

4 <!-- displayBook.py into XHTML. 

5 <xsl: stylesheet version = . 0 ; ‘ 

6 xmlns:xsl = "http://www.w3.org/1999/XSL/Transform"> 

7 

8 <xsl:output method = "xml" omit-xml-declaration = 

9 indent = "yes" doctype-system = 'DTD/xhtmll-strl 

10 doctype-public = "-//W3C//DTD XHTML 1.0 Striet//EN" /> 

11 

12 <!-- specify the root of the XML document --> 

13 <!— that references this stylesheet --> 

14 <xsl:template mateh = > 

15 <html xmlns = "http://www.w3.org/1999/xhtml" 

16 xml:lang = ;n lang = en"> 

17 

18 <head> 


- - > 
--> 
--> 


Fig. 23.12 XSLT stylesheet that transforms a book's XML representation into an XHTML 
document, 
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19 



20 

<!— obtain book title from script to place in title --> 

21 

<titlexxsl:value-of select = /></title> 

22 



23 

<link rei = 

href = "/bookstore/styles.css" 

24 

type = text/css" /> 


25 

</head> 


26 



27 

<body> 


28 

<p class = ><xsl:value-of select = /></p> 

29 



30 

<table> 


31 

<tr> 


32 

<!— create table 

cell for product image --> 

33 

<td rowspan = 5 "> 

<!— cell spans 5 rows —> 

34 

<img src = /b 


35 

ait = 

le }" /> 

36 

</td> 


37 



38 

<!— create table 

cells for price in row 1 --> 

39 

<td class = "bold’ 

>Price: </td> 

40 



41 

<tdxxsl :value-of 

select = /></td> 

42 

</tr> 


43 



44 

<tr> 


45 



46 

<!-- create table 

cells for ISBN in row 2 --> 

47 

<td class = "bold 

>ISBN #: </td> 

48 



49 

<tdxxsl :value-of 

select = /></td> 

50 

</tr> 


51 



52 

<tr> 


53 



54 

<!-- create table 

cells for edition in row 3 --> 

55 

<td class = "bold 

>Edition: </td> 

56 



57 

<tdxxsl :value-of 

select = /></td> 

58 

</tr> 


59 



60 

<tr> 


61 



62 

< !— create table 

cells for Copyright in row 4 --> 

63 

<td class = "bold 

Copyright: </td> 

64 



65 

<tdxxsl :value-of 

select = /></td> 

66 

</tr> 


67 



68 

<tr> 


69 



70 

<!-- create Add to Cart button in row 5 --> 

71 

<td> 



Fig. 23.12 XSLT stylesheet that transforms a book's XML representation into an XHTML 
document, 
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<form method = 

action = 

3" > 

73 

<pxinput type 

= "submit" 


74 

value = 

Add to Cart /x/p> 


75 

</form> 



76 

</td> 



77 




78 

<!— create View Cart 

button in row 5 -■ 

-> 

79 

<td> 



80 

<form method = "post 

action = "viewCar 

t .py?ID=%s "> 

81 

<pxinput type = 

value = 'View 

Cart / x/p> 

82 

</form> 



83 

</td> 



84 

</tr> 



85 

</table> 



86 




87 

</body> 



88 




89 

</html> 




90 

91 </xsl:template> 

92 </xsl:stylesheet> 



Fig. 23.12 XSLT stylesheet that transforms a book's XML representation into an XHTML 
document, 

Lines 21 and 28 place the book’s title in the document’s title element and in a 
paragraph at the beginning of the document’s body element, respectively. Line 34 speci- 
fies an img element that holds the value of the imageFile element of an XML docu- 
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ment. This element specifies the name of the file representing the book’s cover image. Line 
35 specifies the ait attribute of the img element using the book’s title. Lines 41, 49, 
57 and 65 place the book’s price, isbn. editlonNumber and Copyright in table 
cells, respectively. Lines 72-75 and lines 80-82 create Add to Cart (addToCart .py) 
and View Cart (viewCart .py) buttons, respectively. Both buttons use the POST form 
method to pass the session ID to their target file. 


23.9 Adding an Item to the Shopping Cart 

When the user presses the Add to Cart button in the document produced by the last sec- 
tion, the addToCart .py program updates the shopping cart. Items in the shopping cart 
are represented with Cartltem objects. An instance of this class maintains an item and 
the current quantity for that item in the shopping cart. For use with our Online bookstore, 
Cartltems maintains a Book object and the quantity of that Book in the cart. When the 
user adds an item to the cart, if that Book already is represented in the cart with a Car¬ 
tltem, the quantity of that item is updated in the class. Otherwise, the script creates a new 
Cartltem with a quantity of 1. After updating the cart, the user is forwarded to view¬ 
Cart .py to view the current cart contents. Class Cartltem and addToCart .py are 
shown in Fig. 23.13 and Fig. 23.14, respectively. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 


# Fig. 23.12: Cartltem.py 

# Maintains an item and a quantity 

class Cartltem: 

..Class that maintains an item and its 

def _ init_( self, itemToAdd, number ): 


self.item = itemToAdd 
self.quantity = number 

def getltem( self ): 


return self.item 
def setQuantity( self, number ): 

self.quantity = number 
def getQuantity( self ): 

return self.quantity 


Fig. 23.13 Cartltems contain an item and the quantity of an item in the 
shopping cart. 
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1 #!c: \Python\python .exe 

2 # Fig. 23.13: addToCart.py 

3 # Create new/update Cartltem for selected Book object 

4 

5 import sys 

6 import Session 

7 import Cartltem 

8 

9 # load Session 

10 try: 

11 session = Session.Session() 

12 except Session.SessionError, message: 

13 Session.redirect( 

14 sys.exit() 

15 

16 book = session[ ] 

17 bookISBN = book.get ISBN () 

18 cart = session[ ] 

19 alreadylnCart = 

20 

21 # determine if book is in cart 

22 for isbn in cart.keys(): 

23 

if isbn == bookISBN: 

25 alreadylnCart = 

cartltem = cart[ isbn ] 
break 

28 

29 # if book is already in cart, update guantity 

30 if alreadylnCart: 

cartltem.setQuantity( cartItem.getQuantity() + ) 

32 

33 # otherwise, create and add a new Cartltem to cart 

34 else: 

cart[ book.getISBN() ] = Cartltem.Cartltem( book, ) 

36 

37 # update cart attribute 

38 session[ ] = cart 

39 

40 # send user to viewCart.py 

41 nextPage = % session[ ] 

42 session.saveSession() 

43 Session.redirect( nextPage ) 


# invalid/no session ID 

% message ) 


Fig. 23.14 addToCart. py places an item in the shopping cart and invokes 
viewCart .py to display the cart contents. 

The program first obtains the Session object for the current client (lines 10-14). If 
a session does not exist for this client, a RequestDispatcher forwards the request to 
error.py (line 13). Otherwise, line 16 obtains the value of session attribute book- 
ToAdd— the Book representing the book to add to the shopping cart. Lines 17 obtains this 
Book’s ISBN. Line 18 obtains the value of session attribute cart —the dictionary that 
represents the shopping cart. Lines 22-27 locate the Cartltem for the book being added 
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to the cart. If the shopping cart already contains an item for the specified book, line 31 
increments the quantity for that Cartltem. Otherwise, line 35 creates a new Cartltem 
with a quantity of 1 and puts the item into the shopping cart, keyed by the book ISBN. Line 
38 sets cart session attribute to reference the dictionary cart. Then, lines 41-43 forward 
the user to viewCart. py to display the cart contents. 


23.10 Viewing the Shopping Cart 

Program viewCart.py (Fig. 23.15) extracts the Cartltems from the shopping cart, 
subtotals each item in the cart, totals ali the items in the cart and creates a document that 
allows the client to view the cart in tabular format. 


1 #!c: \Python\python.exe 

2 # Fig. 23.14: viewCart.py 

3 # Generate XML representing cart, convert 

4 # to required format using client-specific XSLT 

5 # stylesheet and display results. 

6 

7 import sys 

8 import Session 

9 from xml.xslt import Processor 

10 from xml.dom.DOMImplementation import implementation 

11 

12 # load Session 

13 try: 

14 session = Session.Sessioni) 

15 except Session.SessionError, message: 

16 Session.redirect( 

17 sys.exitO 

18 

19 cart = sessioni 1 

20 total = 

21 

22 # generate XML representing cart object 

23 document = implementation.createDocument( None, None, None ) 

24 cartNode = document.createElement( ) 

25 document.appendchild( cartNode ) 

26 

27 # add XML representation for each cart item 

28 for item in cart.values(): 

29 

30 # get book data, calculate subtotal and total 

31 book = item.getltem() 

32 quantity = item.getQuantity() 

33 price = float( book.getPrice() ) 

34 subtotal = quantity * price 

35 total += subtotal 

36 

37 # create an orderProduct element 

38 orderProduct = document.createElement( ) 

Fig, 23.15 viewCart .py obtains the shopping cart and outputs a document with 
the cart contents in tabular format. 


# invalid/no session ID 

% message ) 
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66 
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68 

69 

70 

71 

72 

73 

74 

75 

76 


# create a product element and append to orderProduct 

productNode = book.getXML( document ) 
orderProduct.appendChild( productNode ) 

# create a quantity element and append to orderProduct 

quantityNode = document.createElement( ) 

quantityNode.appendchild( document.createTextNode( 
quantity ) ) 

orderProduct.appendchild( quantityNode ) 

# create a subtotal element and append to orderProduct 

subtotalNode = document.createElement( ) 

subtotalNode.appendchild( document.createTextNode( 
subtotal ) ) 

orderProduct.appendchild( subtotalNode ) 

# append orderProduct to cartNode 

cartNode.appendchild( orderProduct ) 

# set the total attribute of cart element 

cartNode.setAttribute( , % total ) 


# make current total a session attribute 

sessioni 1 = total 

# process generated XML against XSLT stylesheet 

processor = Processor.Processor() 

style = open( sessioni 1 + ) 

processor.appendStylesheetString( style.read() % ( sessioni 
sessioni 1 ) ) 

results = processor.runNode( document ) 
style.close() 

# display content type and processed XML 

pageData = sessioni 1 + results 

session.saveSession() 
print pageData 



1 , 


Fig. 23.15 viewCart .py obtains the shopping cart and outputs a document with 
the cart contents in tabular format. 

We first load the session (lines 13-17). If an error occurs, the client is redirected to 
error.py. Line 19 obtains the shopping cart attribute of the session. We then create a 
new XML Document and append a cart element to Document (lines 23-25). 

Lines 28-57 compute the total of the items in the cart. Lines 31, 32 and 33 retrieve the 
Book object, the quantity and the price from the Cartltem, respectively. Line 34 calcu- 
lates the subtotal for the Cartltem. Line 35 updates the total cost of ali cart items. Line 
38 creates an XML orderProduct element for each item in the cart. 

Each orderProduct element contains 3 children elements: product, quantity 
and subtotal. We first retrieve and append the product child of orderProduct 
(lines 41-42). Lines 45^-8 then create and append the quantity element. Note that the 
quantity of the current Cartltem must be formatted to a string before creating the ele- 
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ment. Lines 51-54 create and append the subtotal child of orderProduct. The 
subtotal element contains the subtotal of the current Cartltem, formatted to two dec- 
imal places. Line 57 appends the current orderProduct to the cart element. 

When an orderProduct element has been created and appended to the cart ele¬ 
ment for each Cartltem. the total attribute of the cart element is then set (line 60). 
Line 63 Stores the current sales total in the total attribute of the session. Lines 66-71 pro- 
cess the XML Document against a client-specific XSLT stylesheet (viewCart .xsl). 
Note that session ID must once again be inserted into the stylesheet before processing. 
Lines 74-76 save the session and display the translated XML to the client. 

Figure 23.16 contains the viewCart .xsl style sheet file used in the XSLT transfor- 
mation for an html client. The resulting XF1TML document is shown in the screen capture 
at the end of Fig. 23.16. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 


<?xml version = "1.0 ?> 

<!-- Fig. 23.15: viewCart.xsl --> 

<!-- XSLT stylesheet that transforms XML generated by --> 
<!-- viewCart.py into XHTML. --> 

<xsl:stylesheet version = "1.0" 

xmlns:xsl = "http://www.w3.org/1999/XSL/Transform"> 


<xsl:output method = "xml" omit-xml-declaration = 
indent = "yes" doctype-system = 
doctype-public = "-//W3C//DTD XHTML 1.0 Striet 


<xsl:template mateh 
<html xmlns = i 
xml:lang = 


rt "> 

lang = 


> 


/> 



<head> 

<title>Your Online Shopping Cart</title> 
clink rei = "stylesheet" href = "/bookstore/styles. 
type = 'text/css" /> 

</head> 

<body> 

<p class = Shopping Cart</p> 

<xsl:choose> 

<xsl:when test = total = 0. > 

<p class = > 

Your shopping cart is currently empty.</p> 

</xsl:when> 

<xsl:otherwise> <!-- total != 0.00 --> 

<table class = "cart > 

<tr> 

<th>Product</th> 

<th: Quantity< /th> 

<th>Price</th> 


Fig. 23.16 XSLT stylesheet that transforms a carfs XML representation into an XHTML 
document, 
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60 
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<th>Total</th> 

</tr> 

<xsl:apply-templates select = > 

<!-- sort orderProducts by product/title --> 
<xsl:sort select = "product/t ; tle"/> 

</xsl:apply-templates> 

<tr> 

<td colspan 
class = 
select = 

</tr> 

</table> 

</xsl:otherwise> 

</xsl:choose> 

<p class = bold green > 

<a href = >Continue Shopping :/a> 

</p> 

<form method = "post" action = "order.py?ID=%s' > 

<pxinput type = value = /></p> 

</form> 

</body> 

</html> 

</xsl:template> 

<xsl:template match = 'orderProduct > 

<tr> 

<tdxxsl:value-of select = />, 

<xsl:value-of select = 1 />e</td> 

<tdxxsl :value-of select = /x/td> 

<td class = xxsl:value-of select = 

"product/price /x/td> 

<td class = xxsl:value-of select = 

"subtot /x/td> 

</tr> 

</xsl:template> 

</xsl:stylesheet> 


>Total: <xsl:value-of 
/x/td> 


Fig. 23.16 XSLT stylesheet that transforms a cart's XML representation into an XHTML 
document, 
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Fig. 23.16 XSLT stylesheet that transforms a cart's XML representation into an XHTML 
document, 

The first xsl: template (lines 12-68) matches cart elements. Line 26 begins an 
xsl:choose element. If cart attribute (denoted by @) total is equal to "0.00", 
lines 28-29 execute. Lines 28 and 29 display a message to the client indicating the shopping 
cart is currently empty. If, however, total is not "0.00", lines 33-54 are executed, cre- 
ating a table for ali the items in the cart. 

Lines 41—46 insert all matches to the orderProduct template, sorted by their 
product/title element. The orderProduct template (lines 70-82) matches 
orderProduct elements. Lines 73-79 insert the orderProduct’s product/ 
title, product/editionNumber, quantity, product/price and sub- 
total in table cells. Lines 49-51 then insert a table row displaying the total for all items. 
We then create two options for the user. The first is a hyperlink that points to all- 
Books. py (line 59). The second is a Check Out button that takes the user to order. py 
(lines 62-64). 


23.11 Checking Out 

When viewing the cart, the user can click a Check Out button to proceed to order .py 
(Fig. 23.17). This script retrieves a static page called orderForm which is different for 
each client type. The correct file is stored in a subdirectory named after the client type (e.g. 
orderForm.html for an HTML client). File orderForm is a form in which the user 
inputs nante, address, and credit card information to complete an order. In this example, the 
form has no functionality. However, it is provided to help complete the application. Nor- 
mally, there would be some client-side validation of the form elements, some server-side 
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validation of form elements or a combination of both. When the user presses the button, the 
browser requests process . py to finalize the book order. 


1 #!c:\Python\python.exe 

2 # Fig. 23.16: order.py 

3 # Display order form to get Information from customer 

4 

5 import sys 

6 import Session 

7 

8 # load Session 

9 try: 

session = Session.Session() 

11 except Session.SessionError, message: 

12 Session.redirect( 

13 sys.exitO 

14 

15 # display content type and orderForm for specific client-type 

16 content = open( % ( session[ ], 

17 session[ ] ) ) 

18 pageData = session[ ] + content.read() % \ 

19 sessioni 1 

20 content.close() 

21 

22 session.saveSessionf) 

23 print pageData 


# invalid/no session ID 

% message ) 


Fig. 23.17 order .py retrieves, formats and displays a static order form page to the 
Client, 

Lines 9-13 first load the session. If an error occurs, the client is forwarded to 
error.py. Line 16 opens the client-specific order form. Note that for convenience, the 
directory name is the same as the file extension. Lines 18-19 create the string that contains 
the client content type and the contents of orderForm, formatted with the session ID. The 
session then saves and the order form displays (lines 22-23). 

Figure 23.18 shows orderForm. html, the order form displayed by order. py to 
HTML clients. The resulting XHTML document is displayed in the screenshot below. 


1 

< !— Fig. 23.17 

: orderForm.html 

--> 

2 

<! — Static XHTML to be displayed by order.py 

--> 

3 

<!DOCTYPE html 

PUBLIC "-//W3C//DTD XHTML 1.0 Stric 


4 


striet.dtd" > 


5 




6 

chtml xmlns = 



7 

xml:lang = 

en" lang = "en"> 


8 




9 

<head> 



10 




11 

<title>Order</title> 



Fig. 23.18 orderForm.html is the order form displayed by order. py for html 
clients, 
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clink rei = href = /bookstore/styles,css" 

type = "text/css" /> 

</head> 

<body> 

<p class = : Shopping Cart Check Out</p> 

<!-- Form to input user information and credit card. --> 
<!-- Note: No need to input real data in this example. --> 

<form method = 'pos action = > 

<p style = "font-weight bold"> 

Please input the following information</p> 

<table> 

<tr> 

<td class = >First name:</td> 

<td> 

<input type 
size = 

</td> 

</tr> 

<tr> 

<td class = 

<td> 

<input type 
size = 

</td> 

</tr> 

<tr> 

<td class = 

<td> 

<input type 
size = 

</td> 

</tr> 

<tr> 

<td class = 

<td> 

<input type 
size = 

</td> 

</tr> 

<tr> 

<td class = 

<td> 

<input type = "t name = "state" 

Fig. 23.18 orderForm.html is the order form displayed by order .py for html 
clients, 


text name = 

/> 


>State: </td> 


sxt" name = 

/> 


>City: </td> 


text" name = 
/> 


>Street:</td> 


text name = 
/> 


Last name:</td> 
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65 

size = 


/> 


66 

</td> 




67 

</tr> 




68 

<tr> 




69 

<td class = 



>Zip code:</td> 

70 





71 

<td> 




72 

<input type 

= 


st 51 name = zipcode" 

73 

size = "1 


/> 


74 

</td> 




75 

</tr> 




76 

<tr> 




77 

<td class = 



> Phone #:</td> 

78 





79 

<td> 




80 

( 




81 

<input type 

= " 

text" name = "phone" size 

82 

) 




83 





84 

<input type = 



name = "phone2 B1 size = 

85 





86 

<input type 

= 


st" name = phone3” size = 

87 

</td> 




88 

</tr> 




89 

<tr> 




90 

<td class = 



>Credit Card #:</td> 

91 





92 

<td> 




93 

<input type 

= 


«t" name = "creditcard" 

94 

size = "2 


/> 


95 

</td> 




96 

</tr> 




97 

<tr> 




98 

<td class = 



>Expiration (mm/yy) :<> 

99 





100 

<td> 




101 

<input type 

= 


st" name = "expires" 

102 

size = "2 


/> 


103 





104 

<input type 

= 


ut" name = f! expires2" 

105 

size = "2 


/> 


106 

</td> 




107 

</tr> 




108 

</table> 




109 





110 

<pxinput type = 


value = /></p> 

111 

</form> 




112 

</body> 




113 





114 

</html> 





Fig. 23.18 orderForm.html is the order form displayed by order.py for html 
clients, 
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Fig. 23.18 orderForm.html is the order form displayed by order .py for html 
clients, 

23.12 Processing the Order 

Figure 23.19 (process.py) pretends to process the user’s credit-card information and 
retrieves a client-specific document called thankYou (lines 16-17)—a static client-spe- 
cific page. The correct file is stored in a subdirectory named after the client type (e.g., 
thankYou. html for an HTML client). The program then inserts the final dollar total into 
the contents of thankYou (lines 18-19), and displays this page for the client. Our simu- 
lation of a bookstore does not perform real credit-card processing, so the transaction is now 
complete. Line 23 invokes Session method delete to discard the session object for the 
current client. In a real store, the session would not be invalidated until the purchase is con- 
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firmed by the credit-card company. Figure 23.20 shows file thankYou for an HTML Cli¬ 
ent. The resulting XHTML document is displayed in the screenshot below. 


1 #!c:\Python\python.exe 

2 # Fig. 23.18: process.py 

3 # Display thank you page to customer and delete session 

4 

5 import sys 

6 import Session 

7 

8 # load session 

9 try: 

session = Session.Sessioni) 

11 except Session.SessionError, message: 

12 Session.redirect( 

13 sys.exitO 

14 

15 # display content type and thankYou for specific client-type 

16 content = open( % ( sessioni 1» 

17 sessioni ] ) ) 

18 pageData = sessioni 1 + content.read() % \ 

sessioni 1 

20 content.close() 

21 

22 # delete session because Processing is complete 

23 session.deleteSession() 

24 print pageData 


# invalid/no session ID 

% message ) 


Fig. 23.19 process.py retrieves, formats and displays a static thank you page to 
the Client. 


1 

< !-- thankYou.html 

--> 

2 

<!— Static XHTML to be displayed by process.py 

--> 

3 

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Stri 


4 

"DTD/xhtmll-striet.dtd"> 


5 

6 

<html xmlns = "http://www.w3.org/1999/xhtml" 


7 

xml:lang = lang = > 


8 

9 

<head> 


10 

11 

ctitle Thank You!</title> 


12 

13 

clink rei = "stylesheet" href = " /bookstore/st 


14 

type = :t /ce /> 


15 

16 

</head> 


17 

18 

<body> 


19 

<p class = Thank You</p> 


20 

<p>Your order has been processed. </p> 



Fig. 23.20 thankYou.html is the exit page displayed by process .py for HTML 

clients, 
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T\ <p>Your credit card has been biTled": 

<span class = >$%.2f </span> 

23 </p> 

24 </body> 

25 

26 </html> 



Fig. 23.20 thankYou.html is the exit page displayed by process .py for HTML 

clients, 


23.13 Error Handling 

When an error occurs in our Online bookstore, the client is forwarded to error.py 
(Fig. 23.21). 

If an error message is specified in the query string, we begin by creating a new XML 
Document (line 16). Lines 17-18 create error and message elements, respectively. 
Lines 19-20 append the specified error message to the message element. Line 21 appends 
the message element to the error element. Line 22 appends the error element to the 

XML Document. 


1 #!c: \Python\python .exe 

2 # Fig. 23.20: error.py 

3 # Generate XML error message and display to user 

4 # using client-specific XSLT stylesheet. 

5 

6 import egi 

7 import Session 

8 from xml.xslt import Processor 

9 from xml.dom.DOMImplementation import implementation 

10 

11 form = cgi.FieldStorage() 

12 

13 if form.has_key( ): 

14 

Fig. 23.21 error .py displays a dynamically created error page, 
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T5 

document = implementation.createDocument( None, None, None ) 
error = document.createElement( ) 

message = document.createElement( ) 

message.appendChild( document.createTextNode( 

20 form[ ].value ) ) 

21 error.appendChild( message ) 
document.appendChild( error ) 

23 

24 # process against XSLT stylesheet 

25 processor = Processor.Processor() 

style = open( Session.getClientType()[ ] + ) 

processor.appendStylesheetStream( style ) 

28 results = processor.runNode( document ) 

style.close() 

30 

31 # display content type and processed XML 

print Session.getContentType() + results 


Fig, 23.21 error .py displays a dynamically created error page. 

Lines 25-29 process the Document against a client-specific XSLT stylesheet 
(error.xsl). Note that because error .py has no session, it must call Session func- 
tions getClientType and getContentType, to determine the correct files to use. 
The results are displayed for the user (line 32). 

Figure 23.22 contains the error.xsl style sheet file used in the XSLT transforma- 
tion for an HTML client. Lines 12-31 define an xsl : template which matches error 
elements. Line 26 inserts the value of the message element into a paragraph tag. The 
resulting XHTML document is shown in the screen capture at the end of Fig. 23.22. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 


<?xml version = "1.0 ?> 

<!-- Fig. 23.21: error.xsl --> 

<!— XSLT stylesheet that transforms XML generated by --> 
<!-- error.py into XHTML. --> 

<xsl:stylesheet version = "1.0" 

xmlns:xsl = "http://www.w3.org/1999/XSL/Transform"> 

<xsl:output method = "xml" omit-xml-declaration = "no" 
indent = "yes" doctype-system = "DTD/xhtmll-strict. dt 
doctype-public = "-//W3C//DTD XHTML 1.0 Striet//EN" /> 


<xsl:template mateh = 'error' > 

<html xmlns = "http://www.w3.org/19S 

xml:lang = "en" lang = en" > 
<head> 

<title>Error</title> 

<link rei = href = 

type = "text/ese /> 

</head> 


Fig. 23.22 XSLT stylesheet that transforms the XML representation of an error into an 
XHTML document. 
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21 

22 

<body> 


23 

24 

<p class = 

>Error message:</p> 

25 

<p class = "bold' 

> 

26 

<xs1:value-of 

select = "message /> 

27 

28 

</p> 


29 

</body> 


30 

</html> 


31 

</xsl:template> 


32 

</xsl:stylesheet> 




Fig. 23.22 XSLT stylesheet that transforms the XML representation of an error into an 
XHTML document. 


23.14 Handling Wireless Clients (XHTML Basic and WML) 
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Objective 

• To introduce multimedia applications in Python. 

• To understand how to create 3D objects with module 

PyOpenGL. 

• To manipulate Alice 3D objects . 

• To create a CD player with module pygame. 

• To use module pygame to create a 2D Space Cruiser 
game. 



Under 

Constructi on 
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Outline 

24.1 

Introduction 

24.2 

Introduction tO PyOpenGL 

24.3 

PyOpenGL examples 

24.4 

Introduction to Alice 

24.5 

Fox, Chicken and Seed Problem 

24.6 

Introduction to pygame 

24.7 

Python CD Player 

24.8 

pygame Space Cruiser 

24.9 

Internet and World Wide Web Resources 

Summary • Terminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 


24.1 Introduction 

In addition to its many other capabilities, Python allows programmers to create interactive 
multimedia applications. It is increasingly important for programmers to be able to create 
multimedia components. We provide examples using PyOpenGL and Alice. 


24.2 Introduction to PyOpenGL 

Module PyOpenGL is a wrapper for OpenGL. OpenGL is a language for rendering 3D 
graphics. The PyOpenGL module allows the programmer to write Python programs that 
create colorful, interactive 3D graphics. 

OpenGL needs a context in which all its rendering can be displayed. GLUT, wxPython 
and FxPy are possible contexts. The examples in this chapter use Tkinter as OpenGL’s 
context. 

Module PyOpenGL includes the Tkinter component Opengl which allows 
openGL to be displayed. There are two other components in which openGL can be dis¬ 
played— BaseOpengl, from which Opengl inherits, and Pogl. 

By default, the Opengl component has an event bound to each mouse button. Holding 
the left mouse button allows the user to move objects in the Opengl component. The 
middle mouse button rotates objects and the right mouse button resizes objects. 


24.3 PyOpenGL examples 

In this section we present two PyOpenGL examples. Figure 24.1 uses PyOpenGL color- 
ing and transformations to create a rotating, colored box. Note that because we are using 
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Tkinter as the OpenGL context, the program structure is similar to programs found in 
Chapters 10 and 11. 


1 #!c: \Python\python. exe 

2 # A colored, rotating box (with open top and bottom) 

3 

4 from Tkinter import * 

5 from OpenGL.GL import * 

6 from OpenGL.Tk import * 

7 

8 class ColorBox( Frame ): 

9 . A colored, rotating box . 


10 



11 

def _ init_( self ): 


12 



13 



14 

Frame._init_( self ) 


15 

self.master.title( 

) 

16 

self.master.geometry( 

) 

17 

self.packt expand = 

, fili = ) 

18 



19 

# create and pack Opengl -- use double buffering 

20 

self.openGL = Opengl( self, double = ) 

21 

self.openGL.pack( expand = , fili = ) 

22 



23 

self.openGL.redraw = self.redraw 

24 

self.openGL.set_eyepoint( ) 

25 



26 

self.amountRotated = 

# alternate rotating left/right 

27 

self.increment = 

# rotate amount 

28 

self.updatet) 

# begin rotation 

29 



30 

def redrawt self, openGL ; 

) : 

31 



32 



33 

# ciear background and 

disable lighting 

34 

glClearColor( , , 

r , ) 

35 

glClear( 

) # select ciear color 

36 

glDisable( 

) 

37 



38 

# constants 


39 

red = ( , , ; 

i 

40 

green = ( , 

) 

41 

blue = ( , , 

) 

42 

purple = ( , , 

) 

43 



44 

vertices = \ 


45 

[ ( ( 

), red ), 

46 

( ( 

), green ), 

47 

( ( 

), blue ), 

48 

( ( , 

), purple ), 

49 

( ( 

), red ), 

50 

( ( , 

), green ), 


Fig. 24.1 Using Opengl with Tkinter context. 
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51 

( ( , 

) , blue ) , 



52 

( ( 

) , purple ) , 



53 

( ( , 

) , red ), 



54 

( ( 

) , green ) ] 



55 





56 

glBegin( 

) 


57 





58 

# change color and plot point for each vertex 


59 

for vertex in vertices 

s 



60 

location, color = vertex 



61 

apply( glColor3f, color ) 



62 

apply( glVertex3f, 

location ) 



63 





64 

glEnd( ) 

# stop drawing 


65 

glEnable ( 

) # re-enable lighting 


66 





67 

def update( self ): 




68 





69 





70 

if self.amountRotated 

>= : 

rotation 

direction 

71 

self.increment = 

# rotate 

left 


72 

elif self.amountRotated <= : 

rotation 

direction 

73 

self.increment = 

# rotate 

right 


74 





75 

# rotate box around ( 

1.0, 1.0, 1.0 ) 



76 

glRotate( self.increment, , , ) 



77 

self.amountRotated += 

self.increment 



78 





79 

self.openGL.tkRedraw () 

# 

redraw geometry 

80 

self.openGL.after( , 

self.update ) 

call update in lOms 

81 





82 

def main(): 




83 

ColorBox().mainloop() 




84 





85 

if name == : 




86 

main() 





Fig. 24.1 Using Opengl with Tkinter context. 
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Fig. 24.1 Using Opengl with Tkinter context. 

Line 83 creates an instance of class ColorBox (lines 11-80) and enters its main- 
loop. The ColorBox constructor (lines 11-28) first initializes the window (lines 14-17). 
Lines 20-21 create and pack an Opengl component— openGL —which is used to render 
the OpenGL objects. openGL attribute double is set to 1 to ensure that double buffering 
is used. With double buffering, OpenGL maintains two screen buffers—one to display and 
one to update. When the display is updated, the two buffers are simply switched. This 
ensures that the user does see the screen being updated (which can cause a choppy display). 

Line 23 sets openGLs redraw method. This method, redraw, will be called when 
the scene must be redrawn (i.e., something has changed). Method redraw (lines 30-65) 
draws the box on the background. Line 34 calls PyOpenGL function glClearColor to 
specify the color which will be used by function glClear (line 35). Colors are represented 
by a three-element tuple or four-element tuple in the form ( R, G, B ) and ( R, G, B, A ), 
respectively. R , G , B and A stand for red, green, blue and alpha (transparency). Possible 
values are decimal values between 0.0 (none) and 1.0 (full). By combining different values, 
different colors are achieved; The representation for black is ( 0.0, 0.0, 0.0, 0.0 ). Lines 39- 
42 define some other colors. Line 35 calls PyOpenGL function glClear to color the 
background with the previously selected color—black (line 34). The value passed to 
glClear—GL_COLOR_BUFFER_BIT —specifies that the color specified should be 
used to color the background. Line 36 calls PyOpenGL function glDisable to disable 
lighting (GL_LIGHTING) for this example. 

Lines 44-54 create a list of a vertices which define the box. Each element of the list 
contains a vertex location and designated color. Lines 56-64 draw the box. Line 56 calls 
PyOpenGL function glBegin with argument GL_QUAD_STRIP. This ensures that any 
points defined before a subsequent call to function glEnd (line 64) will be connected by a 
strip of polygons. For other acceptable values, review OpenGL documentation. In 
PyOpenGL, three-dimensional points are defined with function glVertex3f . Line 60 
obtains the vertex location and color for each vertex. Line 61 uses function apply to call 
PyOpenGL function glColor3f to change the current drawing color. glColor3f 
takes as arguments three floating-point numbers representing an RGB color. Line 62 then 
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calls function glVertex3f to draw a point in three-dimensional space. The color of the 
point is the color specified by glColor3f (line 61). Because each vertex has a unique 
color, PyOpenGL will interpolate between the colors. Line 64 calls PyOpenGL function 
glEnd, ending the GL_QUAD_STRIP. Finally, line 65 calls PyOpenGL function 
Enable to re-enable lighting. 

Line 24 calls Opengl method set_eyepoint. This method moves the camera 
away from the scene by a specified amount. Lines 26-27 initialize variables amountRo- 
tated and increment. These values will be used to control the rotation of the box. 
Finally, line 28 invokes method update. 

Method update (lines 67-80) rotates the box. Lines 70-73 alter the rotational direc- 
tion, represented by variable increment. Method glRotate (line 76) accepts four 
parameters. The first parameter, in this case variable increment, sets the angle of rota¬ 
tion. The last three floating-point numbers are the coordinates around which the shape 
rotates. Line 77 increments variable amountRotated, which keeps track of how much 
the box has been rotated. The call to method tkRedraw (line 79) causes the Opengl com¬ 
ponent to be redrawn with the rotated shape. Method after (line 80) takes 10 and method 
update as parameters. As a resuit, mainloop schedules update to be called every lOms. 

Figure 24.2 demonstrates several methods of the OpenGL. GLUT module that create 
three-dimensional shapes. Module GLUT is the GL Utilities toolkit. The example creates a 
GUI that allows the user to preview colors and shapes. 


1 #!c: \Python\python. exe 

2 # Demonstrating various GLUT shapes 


3 


4 from Tkinter import * 

5 import Pmw 

6 from OpenGL.GL import * 

7 from OpenGL.Tk import * 

8 from OpenGL.GLUT import * 


9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 


class ChooseShape( Frame ): 


def _ init _( self ): 


Frame._init_( self ) 

Pmw.initialise() 
self.master.title( 
self.master.geometry( 


# initialize openGL 

self.openGL = Opengl( double = ) 

self.openGL.redraw = self.redraw 
self.openGL.pack( expand = , fili 

self.openGL.set_eyepoint( ) 

self.openGL.autospin_allowed = 


# create and pack MenuBar 


# use double-buffering 

# set redraw function 


# move away from object 

# allow auto-spin 


Fig. 24.2 Creating various shapes with GLUT. 
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"29" 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 
81 
82 


self.choices = Pmw.MenuBar( self.openGL ) 

self.choices.pack( fili = ) 

self.choices.addmenu( , None ) 

# possible shapes and arguments 

self.shapes = { : ( , ), 

: <), 

: (), 

• ( , / / 

i ( I / / 

i ( I / I 

• { M M / 

: ( , ), 

: ( , ) } 

self.selectedShape = StringVarO 
self.selectedShape.set( ) 

# add radiobutton menu item for each shape 

sortedShapes = self.shapes.keys() 
sortedShapes.sort() 

for shape in sortedShapes: 

self.choices.addmenuitemf , , 

label = shape, variable = self.selectedShape ) 

self.choices.addmenu( , None ) 

# possible colors and their values 

self.colors = { : ( , 

: ( 

: ( 

: ( 

: ( , 

self.selectedColor = StringVarO 
self.selectedColor.set( ) 

# add radiobutton menu item for each color 

for color in self.colors.keys(): 

self.choices.addmenuitem( , , 

label = color, variable = self.selectedColor ) 

def redrawf self, openGL ): 


), 

), 

), 

), 

) } 


), 

), 

), 

), 


# ciear background and disable lighting 

glClearColor( , , , ) 

glClear( ) 

glDisable( ) 

# obtain and set selected color 


Fig. 24.2 Creating various shapes with GLUT, 
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color = self.selectedColor.get() 
apply( glColor3f, self.colors[ color ] ) 

85 

86 # obtain and draw selected shape 

shape = self.selectedShape.get() 

apply( eval( shape ), self.shapes[ shape ] ) 

89 

glEnable( ) 

91 

92 def main(): 

ChooseShape () .mainloopO 

94 

95 if _ name_ == : 

main() 



4 - 


Fig. 24.2 Creating various shapes with GLUT, 

Line 93 creates an instance of class ChooseShape (lines 10-90) and enters its 
mainloop. Lines 22-25 of the constructor create and pack an Opengl component in the 
same way as Fig. 24.1. Line 26 sets allow_autospin to 1. As a resuit, the user can 
cause a shape to rotate continuously by holding down the middle mouse button, dragging 
it in the direction of the rotation and releasing it. 

Dictionary shapes (lines 35-44) contains GLUT shapes as its keys. The values are 
possible arguments to be passed to the methods which are named after the shapes. Methods 
glutWireCube and glutSolidCube (lines 35-36) accept the length of the cube’s 
side as a parameter—3 in this case. Methods glutwirelcosahedron and glutSo- 
lidlcosahedron (lines 37-38) accept no parameters and create a 20-sided shape with 
a radius of 1.0. Methods glutWireCone and glutSolidCone (lines 39-40) accept 
four parameters—the base, the height, the number of slices and the number of stacks, i.e., 
the number of subdivisions of the cone, along the third axis. Methods glutWireTorus 
and glutSolidTorus (lines 41-42) accept four parameters as well. The first two 
specify the inner and outer radii of the doughnut shape. The last two arguments specify the 
number of sides in each section and the number of divisions in each section. Methods 
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glutWireTeapot and glutSolidTeapot (lines 43—44J accepts the relative size of 
the teapot shape as a parameter. 

Dictionary colors (lines 60-64) contains a list of color names as keys. Each color 
has its RGB tuple as its value. The GUI has a Pmw MenuBar with radiobutton menu items 
for each shape and color. The default selection is a white wire cube. 

Method redraw (lines 74-90) creates a black background (lines 78-79). Method get 
obtains the selected color and shape. Method apply (line 84) applies method 
glColor3f to the RGB value associated with the color key. Method eval evaluates the 
shape function and apply applies the method to any arguments associated with the 
shape’s dictionary key. 


24.4 Introduction to Alice 

Alice (www.alice.org) is a 3D Interactive Graphics Programming Environment 
created by Stage 3 Research Group (www.alice.org/stage3). It is designed for use 
with Microsoft Windows 95/98/NT. Alice makes simple 3D modeling accessible to novice 
users. The simple scripting language can manipulate 3D objects designed with Teddy2 
(www.mtl. t .u-tokyo. ac. jp/~takeo/teddy/teddy .htm) modeling Soft¬ 
ware. In addition to the many objects included with Alice, the user can import many 
common 3D modeling formats (such as .DXF and .OBJ). 

Python can control the Alice environment. A simple and intuitive interface allow the 
user to place objects in the Alice world and to adjust their initial position. After the pro- 
grammer designs the starting scene, a Python script creates interactive animation in this 
world. The animations can also be created without any knowledge of Python. The user can 
access the list of actions for each object with the mouse and can design a sequence of 
actions. Alice translates the sequence of actions into Python code by Alice. A completed 
world can be viewed in a browser using a browser plug-in (www.alice.org/down- 
loads/plugin/). 

Python used with Alice has several significant modifications. In Alice, Python is not 
case sensitive. As a resuit, two variables or methods with the same name may not exist in 
the same namespace. In addition, integer division results in a floating number value (if non- 
integer). So 1/2 would be equal to 0.5 rather than 0. Usually in Python, division of 1/2 
results in 0 because the answer is truncated after the decimal point. 


24.5 Fox, Chicken and Seed Problem 

Figure 24.3 implements the classical Fox, Chicken and Seed problem as a game. The rules 
are simple: Alice Fiddell needs to transport a fox, a chicken and a seed (a flower pot in this 
example) across a river with a boat. She has to operate the small boat, which can only ac¬ 
commodate one additional passenger. The problem is that fox will eat the chicken if they 
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are left on the shore alone. For the same reason, the chicken can not be left alone with the 
flower. 


1 ### Everything below this line is hand-edited Python Code ### 

2 # Fig. 24.01: ChickenFoxSeed.py 

3 # Chicken Fox and Seed problem 

4 

5 FollowTheBoat = Loop( camera.PointAt 

6 ( AliceLiddell.dress.rthigh ) ) 

7 

8 # run the two animation together with a given pause time 

9 def AnimateWithPause( Animationi, Animation2, Object, time ): 

10 

return Loop( DoInOrder( DoTogether( Animationi, Animation2 ), 

12 Wait( time ) ) ) 

13 

14 LoopingFish = Loop( AnimateWithPause 

15 ( Fish.Move( , , Duration = ), 

Fish.Turn( , , Duration = ), 

17 Fish, ) ) 

18 LoopingFish2 = Loop( AnimateWithPause 

19 ( Fish2.Move( , , Duration = ), 

20 Fish2.Turn( , , Duration = ), 

21 Fish2, ) ) 

22 

23 # lists that keep track of object position 

24 thisBank = [ , , ] 

25 theBoat = [] 

26 otherBank = [] 

27 

28 currentBank = thisBank 

29 targetBank = otherBank 

30 selected = None 

31 

32 # animal select callback 

33 def animalSelect( value ): 

34 

35 global selected 

36 selected = value 

37 

38 # get object into the boat 

39 def ObjectlnBoat( Object ): 

40 

Object.RespondToCollisionWith( FishBoat.deck, Object.Stop ) 

42 Object.MoveTo( FishBoat.period ) 

43 Object.Move( , , Duration = ) 

44 

45 # get object out of the boat 

46 def ObjectOutOfBoat( Object ): 

47 

48 Object.RespondToCollisionWith( Ground, Object.Stop ) 

Object.Move( , - int( ( len( Object._name ) - ) / ) ) 

50 Object.Move( , ) 

Fig. 24.3 Chicken, Fox and Seed (part 1 of 3). 
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ITT 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 
81 
82 

83 

84 

85 

86 

87 

88 

89 

90 

91 

92 

93 

94 

95 

96 

97 

98 

99 

100 
101 
102 

103 

104 


Object.Move( , , Duration = ) 


# put the currently selected object into the boat 

def getlntoBoat(): 

if ( selected in currentBank and 

( len( theBoat ) == ) and boatArrived() ): 

currentBank.remove( selected ) 
theBoat.append( selected ) 

ObjectlnBoat( eval( selected ) ) 

# remove currently selected object from the boat. 

def getOutOfBoat(): 

if ( selected in theBoat and boatArrived() ): 
theBoat.remove( selected ) 
currentBank.append( selected ) 

ObjectOutOfBoat( eval( selected ) ) 

# game over, AnimationX defaults to an empty sequence 

def finishGame( Animationi, Animation2, final ): 

controlPanel.Destroy() 

FollowTheBoat.stop() 
final.Show() 

Doln0rder( Animationi, Animation2, 

Doln0rder( camera.Place( len( final._name ) + , 

InFrontOf, final ), camera.PointAt( final ) ) ) 

# check if the rules have been violated and the player lost 

def checkRules( currentBank ): 

Animationi = DolnOrderO 
Animat ion2 = DolnOrderO 

if in currentBank: 

if in currentBank: 

Animationi = DoInOrder( camera.PointAt( Flower ), 
Flower.destroy() ) 

if in currentBank: 

Animation2 = DolnOrderf camera.PointAt( Chicken ), 
Chicken.destroy() ) 

if ( in currentBank ) or 

( in currentBank ): 

finishGame( Animationi, Animation2, GAMEOVER ) 

if len( currentBank ) == 

not ( currentBank == targetBank ): 
finishGame( Animationi, Animation2, CONGRATULATIONS ) 


Fig. 24.3 Chicken, Fox and Seed (part 2 of 3). 
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T05" 

106 

107 

108 

109 

110 
111 
112 

113 

114 

115 

116 

117 

118 

119 

120 
121 
122 

123 

124 

125 

126 

127 

128 

129 

130 

131 

132 

133 

134 

135 

136 

137 

138 

139 

140 

141 

142 

143 

144 

145 

146 

147 

148 

149 

150 

151 

152 

153 

154 

155 

156 


# send the boat to the other shore 

def toOtherShore(): 


if not boatArrived(): 

return 


# boat is stili in transit 


global currentBank, thisBank, otherBank 
if len( theBoat ) == : 

DoInOrder( eval( theBoat[ ] ).Move( , , 

Duration = ), eval( theBoat[ ] ).Turn( Left, , , 

AsSeenby = FishBoat ) ) 

# move the boat and then set alarm to check rules 

Doln0rder( FishBoat.move( , , Duration = ), 

FishBoat.turn( Left, ) ) 

Alice.SetAlarm( , checkRules, ( currentBank ) ) 

if currentBank == thisBank: # switch the currentBank pointer 

currentBank = otherBank 

else: 

currentBank = thisBank 

# the boat has arrived 

def boatArrived(): 

# check to see if the boat is at the shore 

if ( AliceLiddell.DistanceTo( period ) < or 

AliceLiddell.DistanceTo( period2 ) < ): 

return 

else: 

return 0 

# create the control panel and buttons 

controlPanel = AControlPanel ( Caption = ) 

animalListBox = \ 

controlPanel.MakeOptionButtonSet( List = thisBank[ : ], 

Command = animalSelect ) 
buttonToBoat = \ 

controlPanel.MakeButton( Caption = ) 

buttonFromBoat = \ 

controlPanel.MakeButton( Caption = ) 

buttonMoveBoat = \ 

controlPanel.MakeButton( Caption = ) 

buttonToBoat.SetCommandf getlntoBoat ) 
buttonFromBoat.SetCommand( getOutOfBoat ) 
buttonMoveBoat.SetCommand( toOtherShore ) 

# initial selection defaults to the first element (the fox) 

animalListbox.children[ ].SetValue( ) 
selected = 


Fig. 24.3 Chicken, Fox and Seed (part 3 of 3). 
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The initial scene was created in the Alice world, using predefined objects. Alice Lid- 
dell is attached to the boat. The chicken, fox and flower are initially placed next to the boat 
on the same shore. Ali other items are inserted merely for decoration. The movements can 
be controlled using the buttons on controlPanel (line 139). The menu allows the user 
to move the objects in and out of boat and to send Alice across the river. Alice generates 
the comment in line 1. Code automatically generated by Alice is placed above this com- 
ment. 

Lines 5-6 continuously point the camera at Alice Liddell. This loop ensures that the 
camera follows Alice Liddell as she moves on the boat. Alice adds a loop to the list of 
currently running animations and the loop runs until explicitly stopped. 

Method AnimateWithPause (lines 9-12) combines two animations into one loop. 
The animations run concurrently and then pause for a given time. This method animates 
fish movement. Lines 14-21 create the animations for two jumping fish. 

Lines 24-29 create lists and initialize them to the starting values. These lists keep track 
of the objects on the shores and on the boat. Variable selected (line 30) holds the cur¬ 
rently selected object. Method animalSelect (lines 33-36) is a callback for the radio 
buttons allowing the user to select an object. Method ObjectlnBoat (lines 39-43) 
moves a given object into the boat. Line 41 sets Object. Stop as the response to collision 
with the deck of the FishBoat. Lines 42—43 move the object above the deck and move it 
down toward a collision with the deck. 

Method Ob jectOutOfBoat (lines 46-51) moves a given object out of the boat to 
the shore. The boat movement is symmetric so there is no need to distinguish between the 
shores when moving the object. Line 48 sets the response to collision with the ground to 
Ob j ect. Stop. Line 49 displaces the object based on the name length so that the objects 
land in different positions on the shore. Line 50-51 move the object back and down accord- 
ingly. 

Method getlntoBoat (lines 55-61) checks whether a currently selected object can 
be moved into the boat. If the object can be moved into the boat, the method performs the 
necessary adjustment to the lists. The call ObjectlnBoat.eval ( selected ) (line 
61) returns the object associated in Python environment with selected. Line 57 checks 
whether selected is on the current bank of the river. Line 58 checks whether the boat is 
empty and whether the animation has finished moving the boat across the river (method 
boatArrived). Lines 59-60 move the selected object from the currentBank list to 
theBoat list. 

Method getOutOfBoat (lines 64-69) checks if a currently selected object can be 
moved to the shore from the boat. If the object can be moved to the shore, the method per¬ 
forms the necessary adjustment to the lists and calls Ob jectOutOfBoat. Line 66 checks 
whether selected is in the boat and whether the boat has arrived at the shore. Lines 67- 
68 move the selected object from list theBoat to list currentBank. 

Method f InlshGame (lines 72-79) cleans up once the player loses or wins the game. 
Line 74 destroys the controlPanel, and line 75 stops the camera animation that follows 
the boat. Line 76 displays the variable f inal, the resuit of the game. Lines 77-79 display 
the two animation parameters and then points the camera at f inal. 

Lines 82-103 define method checkRules. Lines 84-85 declare empty animations. 
Lines 87-95 check if one of the rules has been violated and change Animationi and 
Animation2 accordingly. If one of the conditions has been violated, lines 97-99 call 
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finishGame with GAMEOVER as the resuit parameter. Lines 101-103 call finish- 
Game with CONGRATULATIONS as a parameter if all objects were successfully trans- 
ported to the other shore. 

Method toOtherShore moves the boat between the river shores. Lines 108-109 
returns without changing anything if the boat is in transit. Lines 111 makes global variables 
accessible within the method. Lines 113-116 checks if there is an object on the boat and if 
there is, animate that object with the boat. An object on the boat is not a part of the boat, so 
a separate animation is created to synchronize the object with the boat. 

Lines 119-121 create the animation that moves the boat to the other shore. Line 121 
sets an alarm so that, a second after the boat leaves the shore, the program checks whether 
the rules have been violated. Alarms are timed events in Alice. Alice. SetAlarm takes 
the time to wait until setting off an alarm and a function to call at that time. Optionally, 
parameters for that function can be provided. Lines 123-126 switch the current bank 
pointer to the other shore. 

Method boatArrived checks the status of the boat. If the boat is moving across the 
river, this method returns 0, otherwise it returns 1. This is done using two period objects at 
two sides of the river. These objects are placed where Alice is located when at the shore 
and by checking the distance between them we are able to determine if she arrived. 

Line 134 creates the controlPanel for user input. Lines 141-142 create the set of 
radio buttons using the list of the objects at the bank and the callback animalSelect. 
Lines 143-146 create the buttons for getting the selected object in and out of the boat. Lines 
147-148 create a button that sends the boat across the river. Lines 150-152 set the callbacks 
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for these buttons. Finally, lines 155-156 set the initial selection to "Fox". Figure 24.4 
demonstrates what the example world looks like. 



Alice - Camera (12.06 Frames/Second) 


.JfiJxJ 


Camera Controls 




EyeHeightj _ tundi .)-> 

„Reset Camera ^ 


V~ iAlwavs keep this window on top 


Fig. 24.4 Screenshot of Alice world, 

24.6 Introduction to pygame 

pygame is a set of Python modules designed for writing games. The pygame modules, 
written by Pete Shinners, use the Simple DirectMedici Lciyer ( SDL ). SDL is a cross-platform 
library that provide access to multimedia hardware. pygame allows users to access this li- 
brary through Python. Although various other types of programs have been developed with 
pygame, the most common application is a two-dimensional game. For more information 
about pygame, including extensive documentation, visit www. pygame. org. 


© Copyright 1992-2002 by Deitel & Associates, Inc. AII Rights Reserved. 8/29/01 



































pythonhtpl_24.fm Page 1084 Wednesday, August 29, 2001 4:23 PM 




1084 Multimedia 


Chapter 24 


24.7 Python CD Player 


This section demonstrates pygame’s cdrom module. The cdrom module contains class 
CD and functions to initialize the CD-ROM subsystem. Class CD represents the user’s CD- 
ROM drive. Methods of this class allow the user to access the CD in the drive. Figure 24.5 
creates a simple CD player using pygame module cdrom. We use Tkinter and Pmwto 
create the CD player interface. For more information on Tkinter and Pmw, review Chap- 
ters 10 and 11. 


1 #!c: \Python\python. exe 

2 # CDPlayer.py: A simple CD player using Tkinter and pygame 

3 

4 import sys 

5 import string 

6 import pygame, pygame.cdrom 

7 from Tkinter import * 

8 from tkMessageBox import * 

9 import Pmw 


10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 


class CDPlayer( Frame ): 


def _ init_( self ): 


def createGUI( self ): 


def destroy( self ): 


pygame.cdrom.init() 


pygame.cdrom.quit() 
Frame.destroy( self ) 


Frame._init_( self ) 

self.pack( expand = 
self.master.title( 


else: 

sys.exit( 


# display current track playing 


self.createGUI() 
self.updateTime() 


if self.CD.get_init(): 
self .CD.stopO 


if pygame.cdrom.get_count() > 
self.CD = pygame.cdrom.CD( 


fili 




Fig. 24.5 Python CD player (part 1 of 5). 
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83 

84 
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87 

88 

89 

90 

91 

92 

93 

94 

95 

96 

97 


self.trackLabel = IntVarO 
self.trackLabel.set( ) 

self.trackDisplay = Label( self, font = , 

textvariable = self.trackLabel, bg = , 

fg = ) 

self.trackDisplay.grid( sticky = + + + ) 

# display current time of track playing 

self-timeLabel = StringVarO 

self-timeLabel.set( ) 

self.timeDisplay = Label( self, font = , 

textvariable = self.timeLabel, bg = , 

fg = ) 

self-timeDisplay.grid( row = , column = , columnspan = , 

sticky = + + + ) 

# play/pause CD 

self-playLabel = StringVarO 
self-playLabel.set( ) 

self.play = Button( self, textvariable = self-playLabel, 
command = self.playCD, width = ) 

self-play.grid( row = , column = , columnspan = , 

sticky = + + + ) 

# stop CD 

self.stop = Button( self, text 
command = self.stopCD ) 
self-stop.grid( row = , column 

sticky = + + + ) 

# skip to previous track 

self-previous = Button( self, text = , width = , 

command = self-previousTrack ) 
self-previous.grid( row = , column = , sticky = + + + ) 

# skip to next track 

self.next = Button( self, text = , width = , 

command = self.nextTrack ) 

self-next-grid( row = , column = , sticky = + + + ) 

# eject CD 

self.eject = Button( self, text 
command = self.ejectCD ) 
self-eject.grid( row = , column 

sticky = + + + ) 

# pulldown menu of all tracks on CD 

self-trackChoices = Pmw.ComboBox( self, label_text = 

labelpos = , selectioncommand = self.changeTrack, 

fliparrow = , listheight = ) 

self-trackChoices.grid( row = , columnspan = , 

sticky = + + + ) 

self.trackChoices.component( )-config( bg = 


, width = 

, columnspan = , 


, width = 

= , columnspan = 


Fig. 24.5 Python CD player (part 2 of 5). 
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123 

124 
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128 
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151 


Fig. 24.5 


fg = , state = ) 

self.trackChoices.component( ).config( bg = 

fg = ) 

def playCD( self ): 


# if disc has been ejected, reinitialize drive 

if not self.CD.get_init(): 
self.CD.init() 
self.currentTrack = 

# if no disc in drive, uninitialize and return 

if self.CD.get_empty(): 
self.CD.quit() 

return 

# if a disc is loaded, obtain disc information 
else: 

self.totalTracks = self.CD.get_numtracks() 
self.trackChoices.component( ).setlist( 

range( , self.totalTracks + ) ) 

self.trackChoices.selectitem( ) 

# if CD is not playing, being play 

if not self.CD.get_busy() and not self.CD.get_paused(): 
self.CD.play( self.currentTrack - ) 

self.playLabel.set( ) 

# if CD is playing, pause disc 

elif not self.CD.get_paused(): 
self.CD.pause() 
self.playLabel.set( ) 

# if CD is paused, resume play 
else: 

self.CD.resume() 

self.playLabel.set( ) 

def stopCD( self ): 


if self.CD.get_init(): 
self .CD.stopO 

self.playLabel.set( ) 

def playTrack( self, track ): 


if self.CD.get_init(): 

self.currentTrack = track 

self.trackLabel.set( self.currentTrack ) 

self.trackChoices.selectitem( self.currentTrack - ) 


Python CD player (part 3 of 5). 
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175 

176 

177 

178 

179 

180 
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184 

185 

186 
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188 

189 

190 

191 

192 

193 

194 

195 

196 

197 

198 

199 

200 
201 
202 

203 

204 

205 


# start beginning of track 

if self.CD.get_busy(): 

self.CD.play( self.currentTrack - ) 

elif self.CD.get_paused(): 

self.CD.play( self.currentTrack - ) 

self.playCD() 

def nextTrackf self ): 


if self.CD.get_init() and \ 

self.currentTrack < self.totalTracks: 
self.playTrack( self.currentTrack + ) 

def previousTrack( self ): 


if self.CD.get_init() and self.currentTrack > : 

self.playTrack( self.currentTrack - ) 

def changeTrack( self, event ): 


if self.CD.get_init(): 

index = int( self.trackChoices.component( 
).curselectionf)[ ] ) 

self.playTrack( index + ) 

def ejectCD( self ): 


response = askyesno( , ) 

if response: 

self.CD.init() 

self.CD.eject() 

self.CD.quit() 

self.trackLabel.set( ) 

self.timeLabel.set( ) 

self.playLabel.set( ) 

self.trackChoices.component( ).ciear() 

self.trackChoices.component( ).ciear() 

def: updateTime( self ): 


if self.CD.get_init(): 

seconds = int( self.CD.get_current()[ ] ) 

endSeconds = int( self.CD.get_track_length( 
self.currentTrack - ) ) 

# if reached end of current track, play next track 

if seconds >= ( endSeconds - ): 

self.nextTrack() 


Fig. 24.5 Python CD player (part 4 of 5). 
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229 

230 

231 

232 

233 

234 

235 

236 


else: 

minutes = seconds / 

endMinutes = endSeconds / 

seconds = seconds - ( minutes * ) 

endSeconds = endSeconds - ( endMinutes * ) 

# display time in format mm:ss/mm:ss 

trackTime = string.zfili( str( minutes ), ) + \ 

+ string.zfill( str( seconds ), ) 

endTime = string.zfill( str( endMinutes ), ) + \ 

+ string.zfill( str( endSeconds ), ) 

if self.CD.get_paused(): 

# alternate pause Symbol and time in display 

if not self.timeLabel.get() == : 

self.timeLabel.set( ) 

else: 

self.timeLabel.set( trackTime + + endTime ) 

else: 

self.timeLabel.set( trackTime + + endTime ) 

# call updateTime method again after lOOOms ( 1 second ) 

self.after( , self.updateTime ) 

def main(): 

CDPlayer().mainloop() 

if _ name_ == : 

main() 


4 - 



Fig. 24.5 Python CD player (part 5 of 5). 

Line 233 creates a CDPlayer object and enters its mainloop. The CDPlayer con¬ 
structor (lines 14-25) initializes the cdrom module (line 17). The if/else statement in 
lines 19-22 checks to see if there are any available CD-ROM drives by invoking cdrom’ s 
get_count function. Function get_count returns the number of CD-ROMs on the 
system. If there is at least one CD-ROM, line 20 instantiates a CD object called CD. The 
value passed to the CD constructor is the ID of the CD-ROM. The program uses the first 
CD-ROM installed on the system if there is more than one. The constructor receives 0 as 


© Copyright 1992-2002 by Deitel & Associates, Inc. AII Rights Reserved. 8/29/01 























































pythonhtpl_24.fm Page 1089 Wednesday, August 29, 2001 4:23 PM 


Chapter 24 


Multimedia 1089 


an argument because the first ID is always 0. The program exits (line 22) if no CD-ROM 
exists. 

Line 24 invokes method createGUI to create the CD player interface. createGUI 
(lines 36-100) creates various GUI components for the CD player and adds them to the dis- 
play. Each component’s action will be discussed later. Note that the Label created to dis- 
play the track number (trackDisplay) and the Label created to display the current 
track time (timeDisplay) both have textvariables—trackLabel and time- 
Label —which will be used to update the CD player display. Notice also that Button 
play has a textvariable—playLabel —which will be used to change its display 
when the CD player is paused or playing. Lines 91-93 create trackChoices, a Pmw 
ComboBox which will be used as a "drop-down" box of track choices. Lines 97-100 use 
common “mega-widget” method component to customize the colors of the drop-down 
box. 

Once the GUI has been created, the constructor calls method updateTime (dis¬ 
cussed later) and returns, entering the malnloop. Once here, the GUI components created 
can be used. 

The Play button has callback method playCD. playCD (lines 102-135) plays or 
pauses the CD. Line 106 check if the CD-ROM is initialized by invoking CD method 
get_init. If the CD-ROM is not initialized, playCD initializes it and sets current- 
Track to 1. current Track Stores the number of the currently playing track. Line 111 
checks if the CD-ROM is empty by invoking CD method get_empty. If the CD-ROM is 
empty, line 112 uninitializes the CD-ROM with CD method quit and returns. Otherwise, 
line 117 obtains the total number of tracks on the disc from CD method get_numtracks 
and Stores that value in variable totalTracks. Lines 118-120 then add them to the drop- 
down box of track choices (trackChoices) and select the first one (track 1). 

Line 123 checks if CD is not playing and not paused with methods get_busy and 
get_paused, respectively. If this is the case, playCD invokes CD method play, speci- 
fying what track to play. Note that because tracks numbers for a CD object begin with 0 and 
people generally believe track numbers begin with 1, the value passed to play is 1 less than 
currentTrack. Line 125 sets the Play button to read " | | ", a Symbol for Paused. 

If the CD is playing and not paused, however, lines 129-130 pause the CD (with CD 
method pause) and set the Play button to read "Play" again. 

If neither condition is met, however, the CD is paused. If this is the case, lines 134 and 
135 resume play with method resume and set the Play button to read " | | " once more. 
Note that if the CD is currently playing, the Play button reads " | | ", and if the CD is cur¬ 
rently paused, the Play button reads "Play". 

The Stop button has callback stopCD (lines 137-142). Line 140 checks if CD is ini¬ 
tialized. If so, CD method stop is invoked to stop the CD and the Play button is set to read 
"Play" once more. Note that calling stop on a CD which is not playing does nothing. 
However, line 140 checks if the CD-ROM is initialized because if it is not, calling stop 
generates an error. 

The »> button has callback nextTrack. nextTrack (lines 159-164) skips to the 
next track on the CD. If CD is initialized and the current track is not the last one, method 
playTrack is invoked, with the next track number specified (currentTrack + 1). 

Similarly, the «< button has callback previousTrack. previousTrack (lines 
166-170) skips to the previous track on a CD. If CD is initialized and the current track is 
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not the first one, method playTrack is invoked, with the previous track number specified 

(currentTrack - 1). 

Method playTrack (lines 144-157) plays a specified track of the CD. If the CD is 
initialized, line 148 sets currentTrack to the specified track number. Lines 149-150 
then set trackLabel to the new track number and select the specified track number from 
the dropdown box. If the CD is currently playing another track, line 154 simply plays the 
specified track instead. If the CD is paused, however, lines 156-157 begin play of the spec¬ 
ified track and then call method playCD to re-pause the disc. 

The dropdown box (trackChoices) has callback method changeTrack. When 
the user selects a track number from the listbox, changeTrack (lines 172-178) is 
invoked. If CD is initialized, lines 176-177 obtain the index of the selection with Tkinter 
ListBox method curselection. Line 178 invokes method playTrack to play the 
selected track (index + 1). 

The Eject button has callback method ejectCD (lines 180-193). Line 183 displays 
a tkMessageBox window which asks the user if the CD should be ejected. This is a safe- 
guard against accidental ejection. If the user chooses to eject the CD, CD is initialized (the 
CD may not be playing), the disc is ejected with CD method eject and CD is uninitialized 
(lines 186-188). Lines 189-193 sets the CD player interface to its initial appearance. 

The CD player updates its display with method updateTime, originally called in line 
25. updateTime (lines 195-230) updates the CD player display (lines 198-227) and 
invokes common widget method af ter. af ter registers a callback that is called after a 
specified amount of milliseconds. Line 230 ensures that method updateTime is called 
every 1000 milliseconds (one second). Line 198 checks if CD is initialized. If not, execution 
skips to line 230. 

Otherwise, the current number of seconds into the currently playing track is obtained 
from CD method get_current and stored in variable seconds (line 199). 
get_current returns a two-element tuple of the current track number and the number 
of seconds into that track. Lines 200-201 obtain the track length from CD method 
get_track_length, specifying the current track (currentTrack - 1). This value is 
stored in variable endSeconds. Lines 204-205 ensure that one track plays consecutively 
after another until the entire disk has been played. Lines 207-210 use seconds and end¬ 
Seconds to determine the current time and end time in minutes and seconds. 

Lines 213-214 create a string for the current track time (trackTime). The string has 
the form mm.ss where mm is minutes and ss is seconds. Note that string function zfill 
pads the string with zeros so that it occupies the correct number of spaces. This ensures that 
minutes or seconds in the range 0-9 (inclusive) resuit in strings of the same length as other 
minute or second values. 

Line 218 determines if the CD is paused. If not, timeDisplay is updated to display 
the current time (line 227). Otherwise, timeDisplay is updated to either the current time 
or a Symbol representing pause (lines 221-224). This ensures that the display flashes 
between the track time and the pause Symbol when paused. 

When finished using the CD player, the user destroys the window, invoking the 
CDPlayer’s destroy method (lines 27-34). Line 30 checks if CD is initialized. If so, 
CD method stop is invoked to stop the CD. If this was not done, the CD would continue 
to play after the user destroyed the window. Lines 33-34 uninitialize the pygame cdrom 
module and destroys the frame with Frame method destroy. 
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Look-and-Feel Observation 24.1 


For Tkinter programs, a destroy method acts as a destructor. 


24.8 Pygame Space Cruiser 

This section demonstrates the most popular use of pygame, a two-dimensional game. 
Figure 24.6 uses various pygame modules to create a simple “Space Cruiser” game. In this 
game, the player Controls a space ship flying through an asteroid field. The player has 60 
seconds to fly through the asteroid field. After 60 seconds, the ship’s fuel is exhausted, and 
the game is over. A clock in the upper-left corner of the screen shows the remaining time. 
Whenever the ship collides with an asteroid, 5 seconds are deducted from the time remain¬ 
ing. However, the ship may also pick up energy packs, which add 5 extra seconds to the 
timer. The player Controls the ship with the arrow keys. 


1 #!c: \Python\python.exe 

2 # SpaceCruiser.py: Space Cruiser game using pygame 

3 

4 import os 

5 import sys 

6 import random 

7 import pygame, pygame.image, pygame.font, pygame.mixer 

8 from pygame.locals import * 

9 

10 class Sprite: 

11 """An object to place on the screen""" 

12 

13 def _ init_( self, image ): 

14 

15 

16 self.image = image 

17 self.rectangle = image.get_rect() 

18 

19 def placet self, screen ): 

20 """Place the object on the screen""" 

21 

return screen.blit( self.image, self.rectangle ) 

23 

24 def removet self, screen, background ): 

25 

26 

return screen.blitt background, self.rectangle, 

28 self.rectangle ) 

29 

30 class Player( Sprite ): 

31 """A Player Sprite with 4 different States""" 

32 

33 def _init_( self, images, crashlmage, 

34 centerX = , centerY = ): 

35 

Fig. 24.6 Pygame example (part 1 of 9). 
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37 

self.movinglmages = images 


38 

self.crashlmage = crashlmage 


39 

self.centerX = centerX 


40 

self.centerY = centerY 


41 

self.playerPosition = 

start player facing down 

42 

self.speed = 


43 

self.loadlmage ( ) 


44 



45 

def loadlmage ( self ): 


46 


2 rectangle""" 

47 



48 

if self.playerPosition == : 

player has crashed 

49 

image = self.crashlmage 


50 

else: 


51 

image = self.movinglmages[ self.playerPosition ] 

52 



53 

Sprite._init_( self, image ) 


54 

self.rectangle.centerx = self.centerX 

55 

self.rectangle.centery = self.centerY 

56 



57 

def moveLeft( self ): 


58 

" ""Change Player image to face om 

2 position to the left""" 

59 



60 

if self.playerPosition == : 

player has crashed 

61 

self.speed = 


62 

self.playerPosition = 

move left of obstacle 

63 

elif self.playerPosition > : 


64 

self.playerPosition -= 


65 



66 

self.loadlmage () 


67 



68 

def moveRight ( self ): 


69 


s position to the right" "" 

70 



71 

if self.playerPosition == : 

player has crashed 

72 

self.speed = 


73 

self.playerPosition = 

move right of obstacle 

74 

elif self.playerPosition < ( len( 

self.movinglmages ) - ): 

75 

self.playerPosition += 


76 



77 

self.loadlmage() 


78 



79 

def decreaseSpeed( self ): 


80 



81 

if self.speed > : 


82 

self.speed -= 


83 



84 

def increaseSpeed( self ): 


85 



86 

if self.speed < : 


87 

self.speed += 


88 



89 

# player has crashed, start player facing down 

Fig. 24.6 

Pygame example (part 2 of 9). 
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120 
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self.playerPosition == 

self.playerPosition = 
self.loadlmage() 

def collision( self ): 


self.speed = 

self.playerPosition = 

self.loadlmage() 

def collisionBox( self ): 


return self.rectangle.inflate( , ) 

def isMoving( self ): 


if self.speed == : 

return 0 
else: 

return 1 

def distanceMoved( self ): 


xlncrement, ylncrement = , 

if self.isMoving(): 

if self.playerPosition == : 

xlncrement = 

ylncrement = * self.speed 

else: 

xlncrement = ( self.playerPosition - ) * self.speed 

ylncrement = self.speed 

return xlncrement, ylncrement 

class Obstacle( Sprite ): 


def _ init_( self, image, centerX = , centerY = ): 


Sprite._init_( self, image ) 

# move Obstacle to specified location 

self.positiveRectangle = self.rectangle 
self.positiveRectangle.centerx = centerX 
self.positiveRectangle.centery = centerY 

# display Obstacle in moved position to buffer visible area 


Fig. 24.6 Pygame example (part 3 of 9). 
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self.rectangle = self.positiveRectangle.move( , ) 

def move( self, xlncrement, ylncrement ): 


self.positiveRectangle.centerx -= xlncrement 
self.positiveRectangle.centery -= ylncrement 

# change position for next pass 

if self.positiveRectangle.centery < : 

self.positiveRectangle[ ] += \ 

random.randrangef , ) 

# keep rectangle values from overflowing 

self.positiveRectangle[ ] %= 
self.positiveRectangle[ ] %= 

# display obstacle in moved position to buffer visible area 

self.rectangle = self.positiveRectangle.move( , ) 

def collisionBox( self ): 


return self.rectangle.inflate( , ) 

class Objective( Sprite ): 

def _init_( self, image, centerx = , centerY = ): 

Sprite._init_( self, image ) 

# move Objective to specified location 

self.rectangle.centerx = centerx 
self.rectangle.centery = centerY 

def move( self, xlncrement, ylncrement ): 


self.rectangle.centerx -= xlncrement 
self.rectangle.centery -= ylncrement 

# place a message on screen 

def displayMessage( message, screen, background ): 
font = pygame.font.Font( None, ) 

text = font.render( message, , ( , , ) ) 

textPosition = text.get_rect() 

textPosition.centerx = background.get_rect().centerx 
textPosition.centery = background.get_rect().centery 
return screen.blit( text, textPosition ) 

# remove old time and place updated time on screen 

def updateClock( time, screen, background, oldPosition ): 


Fig. 24.6 Pygame example (part 4 of 9). 
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remove = screen.blitfbackground, oldPosition, oldPositlonT) 
font = pygame.font.Font( None, ) 

text = font.render( str( time ), , ( , , ), 

( , , ) ) 

textPosition = text.get_rect() 

post = screen.blit( text, textPosition ) 

return remove, post 


def main(): 


# constants 

WAITTIME = 
COURSE„DEPTH = * 

NUMBERASTEROIDS = 

# variables 

distanceTraveled = 
nextTime = 
courseOver = 
allAsteroids = [] 
dirtyRectangles = [] 
energyPack = None 
timeLeft = 


newClock = ( , , , ) 


time to wait between frames 

50 screens long 

Controls number of asteroids 


vertical distance 

time to generate next frame 

the course has not been completed 

randomly generated obstacles 

screen positions that have changed 

current energy pack on screen 

time left to finish course 

the location of the clock 


# find path to ali sounds 

collisionFile = os.path.join( , ) 

chimeFile = os.path.join( , ) 

startFile = os.path.join( , ) 

applauseFile = os.path.join( , ) 

gameOverFile = os.path.join( , ) 


# find path to all images 

shipFiles = [] 

shipFiles.append( os.path.join( , ) ) 

shipFiles.append( os.path.join( , ) ) 

shipFiles.append( os.path.join( , ) ) 

shipCrashFile = os.path.join( , ) 

asteroidFile = os.path.join( , ) 

energyPackFile = os.path.join( , ) 


# obtain user preference 

fullScreen = int( raw_input( 

) ) 


# initialize pygame 

pygame.init() 

if fullScreen: 

screen = pygame.display.set_mode( ( , ), ) 

else: 

screen = pygame.display.set_mode( ( , ) ) 

pygame.display.set caption( ) 


Fig. 24.6 Pygame example (part 5 of 9). 
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pygame.mouse.set visible( ) 

253 

254 # create background and fili with black 

background = pygame.Surface( screen.get_size() ).converto 

256 background.fili( ( , , ) ) 

257 

258 # blit background onto screen and update entire display 

259 screen.blit( background, ( , ) ) 

260 pygame.display.update() 

261 

262 collisionSound = pygame.mixer.Sound( collisionFile ) 

263 chimeSound = pygame.mixer.Sound( chimeFile ) 

264 startSound = pygame.mixer.Sound( startFile ) 
applauseSound = pygame.mixer.Sound( applauseFile ) 
gameOverSound = pygame.mixer.Sound( gameOverFile ) 

267 

268 # load images, convert pixel format and make white transparent 

269 loadedlmages = [] 

270 

271 for file in shipFiles: 

surface = pygame.image.load( file ).convert() 
surface.set_colorkey( surface.get_at( ( , ) ) ) 

274 loadedlmages.append( surface ) 

275 

276 # load crash image 

shipCrashlmage = pygame.image.load( shipCrashFile ).convert() 
shipCrashlmage.set_colorkey( shipCrashlmage.get_at( ( , ) ) ) 

279 

280 # initialize theShip 

281 centerX = screen.get_width() / 

theShip = Player( loadedlmages, shipCrashlmage, centerX, ) 

283 

284 # load asteroid image 

asteroidlmage = pygame.image.load( asteroidFile ).convert() 
asteroidImage.set_colorkey( asteroidlmage.get_at( ( , ) ) ) 

287 

288 # place an asteroid in a randomly generated spot 

289 for i in range( NUMBERASTEROIDS ): 

allAsteroids.append( Obstacle( asteroidlmage, 

random.randrange( , ), random.randrange( , ) ) ) 

292 

293 # load energyPack image 

energyPacklmage = pygame.image.load( energyPackFile ).converti) 
energyPacklmage.set_colorkey( surface.get_at( ( , ) ) ) 

296 

startSound.play() 

298 pygame.time.set_timer( , ) 

299 

300 while not courseOver: 

301 

302 # wait if moving too fast for selected frame rate 

303 currentTime = pygame.time.get_ticks() 

304 

305 if currentTime < nextTime: 

Fig. 24.6 Pygame example (part 6 of 9). 
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305 ' 

307 

308 

309 

310 

311 

312 

313 

314 

315 

316 

317 

318 

319 

320 

321 

322 

323 

324 

325 

326 

327 

328 

329 

330 

331 

332 

333 

334 

335 

336 

337 

338 

339 

340 

341 

342 

343 

344 

345 

346 

347 

348 

349 

350 

351 

352 

353 

354 

355 

356 

357 

358 

359 


pygame.time.delay( nextTime - currentTime ) 

nextTime = currentTime + WAIT_TIME 

# remove all objects from the screen 

dirtyRectangles.append( theShip.remove( screen, 
background ) ) 

for asteroid in allAsteroids: 

dirtyRectangles.append( asteroid.remove( screen, 
background ) ) 

if energyPack is not None: 

dirtyRectangles.append( energyPack.remove( screen, 
background ) ) 

# get next event from event queue 

event = pygame.event.pol1() 

# if player has quit program or pressed escape key 

if event.type == or \ 

( event.type == and event.key == ): 

sys.exit() 

# if up arrow key was pressed, slow ship 

elif event.type == and event.key == : 

theShip.decreaseSpeed() 

# if down arrow key was pressed, speed up ship 

elif event.type == and event.key == : 

theShip.increaseSpeed() 

# if right arrow key was pressed, move ship right 

elif event.type == and event.key == : 

theShip.moveRight() 

# if left arrow key was pressed, move ship left 

elif event.type == and event.key == : 

theShip.moveLeft() 

# one second has passed 

elif event.type == : 

timeLeft -= 

# 1 in 100 odds of creating a new energyPack 

if energyPack is None and not random.randrange( ): 

energyPack = Objective( energyPacklmage, 
random.randrange( , ), ) 

# update obstacle and energyPack positions if ship is moving 

if theShip.isMoving(): 

xlncrement, ylncrement = theShip.distanceMoved() 
for asteroid in allAsteroids: 


Fig. 24.6 Pygame example (part 7 of 9). 
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“35tr 

361 

362 

363 
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366 

367 
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369 

370 

371 
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379 

380 

381 

382 

383 

384 

385 

386 
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388 
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390 
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392 

393 

394 

395 

396 

397 

398 

399 

400 

401 

402 

403 

404 

405 

406 

407 

408 

409 

410 

411 

412 

413 


asteroid.move( xlncrement, ylncrement ) 

if energyPack is not None: 

energyPack.move( xlncrement, ylncrement ) 

if energyPack.rectangle.bottom < : 

energyPack = None 

distanceTraveled += ylncrement 

# check for collisions with smaller bounding boxes 

# for better playability 

asteroidBoxes = [] 

for asteroid in allAsteroids: 

asteroidBoxes.append( asteroid.collisionBox() ) 

# retrieve list of all obstacles colliding with player 

collision = theShip.collisionBox().collidelist( 
asteroidBoxes ) 

# move asteroid one screen down 

if collision != : 

collisionSound.play() 

allAsteroids[ collision ].move( , ) 

theShip.collision() 
timeLeft -= 

# check if player has gotten energyPack 

if energyPack is not None: 

if theShip.collisionBox().colliderect( 
energyPack.rectangle ): 
chime Sound.p1ay() 
energyPack = None 
timeLeft += 

# place all objects on screen 

dirtyRectangles.append( theShip.place( screen ) ) 

for asteroid in allAsteroids: 

dirtyRectangles.append( asteroid.place( screen ) ) 

if energyPack is not None: 

dirtyRectangles.append( energyPack.place( screen ) ) 

# update time 

oldClock, newClock = updateClock( timeLeft, screen, 
background, newClock ) 
dirtyRectangles.append( oldClock ) 
dirtyRectangles.append( newClock ) 

# update changed areas of display 

pygame.display.update( dirtyRectangles ) 


Fig. 24.6 Pygame example (part 8 of 9). 
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dirtyRectangles = [ ] 

415 

416 # check for course end 

417 if distanceTraveled > COURSE DEPTH: 

418 courseOver = 

419 

420 # check for game over 

421 elif timeLeft < = : 

422 break 

423 

424 if courseOver: 

425 applauseSound.play() 

426 message = 

427 else: 

428 gameOverSound.play() 

429 message = 

430 

pygame.display.update( displayMessage( message, screen, 

432 background ) ) 

433 

434 # wait until player wants to close program 

435 while : 

event = pygame.event.pol1() 

437 

438 if event.type == or \ 

( event.type == and event.key == ): 

440 break 

441 

442 if _ name_ == : 

443 main() 


4 - 


Fig. 24.6 Pygame example (part 9 of 9). 

When the program is run, function main (lines 206-440) is executed. Lines 209-221 
create some constants and variables which will be used (and explained later). Lines 224- 
237 locate the sound and image files, which are located in the "data" subdirectory. 
os.path.join ensures that the path will be correct on any platform. The program 
prompts the player to select fullscreen or windowed mode. The player’s response is stored 
in variable fullScreen. 

Line 244 initializes pygame. This call to init is a shortcut for calling each module’s 
init function separately. Lines 246-249 set the current display mode with 
pygame.display function set_mode. The first argument passed to set_mode is a 
two-element tuple specifying a display mode 640 pixels wide and 480 pixels high. If the 
player has selected fullscreen mode, the program passes set_mode flag FULLSCREEN, 
an SDL constant. Otherwise, no flags are passed. The value returned by set_mode is a 
pygame Surface object, a blank canvas onto which the game is drawn. This Surf ace 
object is stored in variable screen. Line 251 sets the window caption to read "Space 
Cruiser! " by invoking pygame .display function set_caption. Line 252 calls 
pygame.mouse function set_visible with argument 0, ensuring that the mouse 
cursor will not appear over the window. 
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Lines 255-256 create the black background for the game. First, the program creates a 
pygame Surf ace that is the same size as the window. The size of the window is obtained 
from screen method get_size. Surface method convert is then invoked on the 
background. convert is used to convert a surface’s pixel format to the display format so 
that blits are performed faster. Blits will be discussed later. The call to background’ s 
fili method filis the background with the color black. The argument passed to fili is 
a three-element tuple representing the RGB values of the desired color. Because black has 
no red, green or blue, it is represented by (0, 0, 0). 

Line 259 blits the background onto the screen. Blitting can be thought of as drawing 
an object on a surface. The call to screen’s blit method in line 259 draws the back¬ 
ground onto the screen at position (0, 0). Position (0, 0) represents the upper-left 
corner of the screen. Because the background is the same size as the screen, the background 
will fili the screen. However, if the screen were visible at this point, it would not yet be 
black. Although the background has been blitted, the display has not been updated. This is 
done in line 260. The pygame. display function update updates the display. If passed 
no arguments, update will update the entire display Surface. We will see later that this 
is not always necessary (or efficient). 

Lines 262-266 load all necessary sound files. Each line creates a Sound object 
(defined in pygame.mixer) from a path created in lines 224-228. Lines 269-278 load 
the ship images. In our game, the ship has four possible States: moving left, moving down, 
moving right and crashed. Because of the implementation of class Player (discussed 
later), the paths to the images representing the first three States are appended to list ship- 
Files (lines 232-234). The for/in loop at line 271-274 iterates over this list, loading 
each image. Line 272 loads an image with pygame. image function load. Note that just 
as the background’s pixel format was converted, the pixel format of each image loaded 
must be converted. The value returned by load is a pygame Surface, which is stored in 
variable surface. Line 273 invokes surface method get_at to obtain the color of 
the image at position (0, 0). For each image, the color at this position is white. surface 
method set_colorkey is then passed this color. The effect is that the color white will 
appear transparent for each surface. Each surface is appended to list loadedlmages. 
Lines 277-278 similarly load the image representing the crashed state. 

Line 281 invokes screen method get_width to obtain the width of the window. 
Because we want our ship to appear halfway across the screen, centerX is assigned half 
of this value. Line 282 creates a Player object and assigns it to variable theShip. The 
arguments passed to the Player constructor ensures that the ship appears halfway across 
the screen, 25 pixels from the top. We will now discuss two classes, Sprite and Player. 

Class Sprite (lines 10-28) defines any object that we place on the screen. The 
Sprite constructor takes as input a pygame Surface called image. Lines 16 Stores this 
Surface in class attribute image. Line 17 computes the image’s bounding rectangle 
with Surface method get_rect, and Stores it in attribute rectangle. The object 
returned by get_rect is a pygame rectstyle. 

A pygame rectstyle represents a rectangular area and may have three possible forms. 
The first is a four-element sequence of the form [ xpos, ypos, width, height ], where xpos 
and ypos are the coordinates of the upper-left corner of the rectangle, and width and height 
are the dimensions of the rectangle. The second is a pair of sequences of the form [ [ xpos, 
ypos ], [ width, height ] ]. The third is an instance of class pygame . Rect. A Rect object 
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represents a rectangle as well, but also has several useful methods. The rectstyle returned 
by get_rect is a Rect object with xpos and ypos of 0. Many pygame functions accept 
rectstyles as arguments rather than just Rect objects (including the Rect constructor). In 
this case, it is possible (and more convenient) to simply pass the function a four-element 
sequence. 

Sprite method place (lines 19-22) “places” the object on the screen. place takes 
as an argument Surf ace screen. screen’s blit method is invoked (line 22) to draw 
the object at position rectangle. Note that changes to rectangle will change where 
the object is drawn. place then returns the value returned by blit, a Rect representing 
the area blitted. 

Sprite method remove (lines 24-28) “removes” an object from the screen by 
drawing the background over it (lines 27-28). Note that this call to blit has three argu¬ 
ments, two of which are rectangle. The third argument specifies what section of 
background to draw at position rectangle. If no third argument were specified, the 
entire background would be drawn at rectangle. remove returns a Rect representing 
the area blitted. 

Class Player (lines 30-128) represents the object controlled by the player which 
appears to move across the screen. In the game, this object is a spaceship. Player inherits 
from class Sprite. Line 282 creates a Player object, invoking Player’ s constructor 
(lines 33-43). Lines 37-40 store the image surfaces and starting position into class 
attributes. Line 41 sets playerPosition to 1. playerPosition is the index of the 
current image being displayed. Because movinglmages is a list of length 3, the indices 
0, 1, 2 represent moving left, moving down and moving right, respectively. Thus, line 41 
starts the Player in state moving down. playerPosition of -1 indicates the player 
has crashed. Line 42 sets attribute speed to 0, and line 43 calls method loadlmage. 

loadlmage (lines 45-55) updates attributes of Player. Lines 48-51 determine the 
correct image to use. If the player has not crashed, the image representing the current player 
state is used (line 51). Line 53 invokes Sprite’s constructor to update the image and 
rectangle attributes. Lines 54-55 move the object to the correct position by changing 
rectangle’s centerx and centery attributes. 

Player methods moveLef t and moveRight are called when the player presses 
the left and right arrow keys, respectively. Because they are similar, we will discuss them 
together. First, an if statement checks if the player has crashed (i.e., playerPosition 
is -1). If so, speed is set to 1 and move the player either to the left (line 62) or right (line 
73) of the obstacle. Otherwise, if the player is not as far left or right as possible, we move 
the player left (line 64) or right (line 75) one position. Finally, method loadlmage 
updates the image. 

Method decreaseSpeed (lines 79-82) is called when the user presses the up arrow 
key. decreaseSpeed decreases attribute speed by 1. Pressing the down arrow key 
invokes method increaseSpeed (lines 84-92). increaseSpeed increases speed 
by 1. Lines 90-92 test if the player has crashed. If so, playerPosition is set to 1 
(moving down) and the image is updated (line 92). 

Player method collision (lines 94-99) is called when the ship collides with an 
asteroid. collision sets speed to 0, sets playerPosition to -1 ( crashed) and 
invokes method loadlmage. Collisions are tested for with the Rect returned by method 
collisionBox (lines 101-104). collisionBox calls Rect method inflate and 
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returns the results. inflate returns a new Rect which represents the calling Rect 
reduced or enlarged around its center by a specified amount. Note that we test for collisions 
with smaller bounding rectangles for playability purposes. Most likely, the image of the 
player are using does not completely fili its rectangle. It would become frustrating to the 
player if collisions were to occur when bounding rectangles intersected, but images did not. 
Using smaller bounding rectangles for collision detection is sometimes referred to as sub- 
rectangle collision. 

Method distanceMoved (lines 114-128) determines the current change in player 
position. Line 119 invokes method isMoving (lines 106-112) to test if the player is 
moving. If so, xlncrement and ylncrement must be calculated. Lines 121-126 use 
playerPosition and speed to determine the distance moved. Note that when moving 
down , the player moves twice as fast in the vertical direction as when moving left or moving 
right. 

Once a Player is instantiated (line 282), the program creates the asteroids. Lines 285 
-286 load the asteroid image, setting white to transparent. The for/in loop in lines 289- 
291 creates NUMBER_ASTEROID asteroids. Each asteroid is an instance of class 
Obstacle (discussed later). The arguments passed to Obstacle’s constructor ensure 
that each asteroid will be randomly placed on the screen. Note that the values passed to 
random. randrange are larger than the screen size in order to buffer the visible area. 
The game will simulate ship movement by moving these asteroids up the screen. The direc¬ 
tion the asteroids move depends upon the current state of the ship. When an asteroid moves 
off the top of the screen, it will be placed on the bottom of the screen again, creating a 
scrolling effect. 

Class Obstacle (lines 130-167) inherits from Sprite. An Obstacle represents 
an object which the player must avoid. In our game, this object is an asteroid. When an 
Obstacle is created, its constructor (lines 133-144) is invoked. Line 136 calls the 
Sprite constructor to initialize the image and rectangle attributes. 

Because we want asteroids to move off the screen completely (i.e., into negative screen 
coordinates) before removing them and placing them back on the screen, we must buffer 
the visible area. In order to do so, we must keep track of two locations for each Obstacle. 
rectangle represents the actual location of the asteroid. This is where we place the 
object. positiveRectangle represents the coordinates of rectangle shifted into 
positive screen coordinates. Lines 139-141 create and initialize the position of posi¬ 
tiveRectangle. Line 144 updates rectangle by invoking Rect method move. 
This effect is that rectangle is now a rectangle of the same dimensions as posi¬ 
tiveRectangle, but shifted by -60 pixels in both the x and y directions. 

Obstacle method move (lines 146-162) is used to move the object. move requires 
arguments xlncrement and ylncrement. Recall that class Player has method 
distanceMoved. This method returns the necessary values. Lines 149-150 move the 
position of positiveRectangle up the screen by the specified amounts. The if state- 
ment at line 153 checks if the asteroid has reached the top of the screen. If so, lines 154— 
155 add a random integer to the xpos of positiveRectangle. This ensures that the 
next time the asteroid appears on the screen, it will not have the same x coordinate as its 
previous pass. If these lines were omitted, the asteroid positions would appear to loop, 
making gameplay boring. Notice that the program treats positiveRectangle, a Rect 
object, as if it were a four-element sequence of the form [ xpos, ypos , width, height]. Lines 
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158-159 make sure that the xpos and ypos of positiveRectangle are within range. 
Finally, now that positiveRectangle has been updated, Rect method move (line 
162) obtains the new rectangle value. 

As with class Player, Obstacle collisions are tested for with the Rect returned 
by method collisionBox (lines 164-167). collisionBox calls Rect method 
inflate and returns the results. 

After the creation of the asteroids (lines 289-291), methods load and convert load 
and convert the energy pack image (line 294), setting white to transparent (line 295). 
During gameplay, energy packs will be created from class Objective. Objective 
(lines 169-184) has a constructor (lines 173-179) and method move (lines 181-185) sim- 
ilar to those of class Obstacle. Line 297 invokes Sound method play to play start- 
Sound. The player will hear this sound when the game begins. Line 298 invokes 
pygame.time function set_timer to generate a USEREVENT event every lOOOms 
(one second). USEREVENT is a pygame constant which represents a user-defined event. 
The effect of line 298 is that every second, a USEREVENT event will be placed onto SDL’ s 
event queue. pygame's event system will be discussed in detail later. 

The while loop in lines 300-422 plays the game. Each iteration checks that 
courseOver is stili 0. If it is, the asteroid field has not yet been crossed, and gameplay 
continues. Lines 303-308 use pygame module time to ensure that the game does not run 
too fast. Line 302 invokes pygame.time function get_ticks. get_ticks returns 
the time, in milliseconds, since pygame. time was imported. This value is stored in vari- 
able currentTime. If currentTime is less than nextTime, the previous number of 
"ticks" plus a constant (WAIT_TIME), we invoke time function delay (line 306). 
delay pauses the execution for a given number of milliseconds. The value passed to 
delay is the number of milliseconds remaining until nextTime. 

Next, the program updates the display. In order to update the positions of ali objects 
on the screen, it would be possible to remove each object, change its position and place 
(i.e., blit) it on the screen again. Then pygame. display. update (as in line 260) could 
update the entire display. However, updating the entire display is inefficient and slow. A 
popular method used to speed up screen updates is called dirty rectangle animation. In dirty 
rectangle animation, we maintain a list of rectangles (representing areas of the display) 
which have been altered (i.e., have become "dirty"). After removing an object from the 
screen, its current rectangle is appended to the list and the object’s position is updated. 
Finally, the program places the object back on the screen and appends its new rectangle to 
the list. Method update is called with the list of "dirty" rectangles. The effect is that 
update will only update those parts of the display which have changed, dramatically 
improving game performance. Note that the list of rectangles passed to update can be a list 
of any rect style. 

The game implements dirty rectangle animation. Lines 311-320 remove the ship, each 
asteroid and the energy pack (if one is present) from the screen by invoking their remove 
methods. Each time, remove returns a Rect representing the area changed. Each Rect 
is appended to list dirtyRectangles. 

We now discuss pygame event handling. As with Tkinter, events can be generated 
from the keyboard or mouse. pygame also handles various other events, including joystick 
events. One method of pygame event handling uses the SDL event queue. As events are 
detected, they are placed on the queue. Each Event object on the queue has a type 
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attribute. Keypress Events have type KEYDOWN. Most user-defined events have type 
USEREVENT. A request to quit the game results in a QUIT event. 

Line 323 invokes pygame.event function poli, poli returns the next Event 
waiting on the queue. This object is stored in variable event. If event is a request to quit 
the game ( QUIT) or a KEYDOWN event with key attribute K_ESCAPE, the program exits 
(line 328). Lines 330-344 check if event was generated by any of the four arrow keys 
(K_UP, K_DOWN, K_RIGHT or K_LEFT). If so, the corresponding Player method is 
invoked. Recall now that line 298 causes one USEREVENT event to be placed on the event 
queue every second. Line 347 checks if event is one of these. If so, tlmeLeft, the time 
remaining to cross the asteroid field, is reduced by 1 (line 348). 

Lines 351-353 attempt to create a new energy pack. If an energy pack does not exists 
(energyPack is None) and randrange returns 0, the program creates a new ener- 
gyPack from class Objective. The arguments passed to Objective’s constructor 
ensure that the pack will start at a random position at the bottom of the screen. Note that 
because the function call passes 100 to randrange, the odds of creating a new pack if one 
does not exist is 1 in 100. 

We then update the positions of the asteroids and energy pack (if one exists). If the ship 
is moving (i.e., speed > 0), we retrieve the xlncrement and ylncrement from 
Player method distanceMoved (line 357). We update the position of each asteroid 
(lines 358-359) and the position of the energy pack (lines 362-363). Line 366 checks if the 
energy pack has moved off the top of the screen. If so, we destroy the current energy pack 
(line 366). Line 368 increments distanceTraveled. 

The next section tests for asteroid collisions. Lines 372-375 create a list, asteroid- 
Boxes, of Rects returned from each asteroid’s collisionBox method. The call then 
passes this list to Rect method collldelist. collidelist returns the index of the 
first rectstyle in a list which overlaps the base rectangle. In line 378-3799, the base rect- 
angle is the Rect returned from the ship’s collisionBox method. When an overlap is 
found, collldeLlst stops checking the remaining list. If no overlap is found, col- 
lldeLlst returns -1. If the ship has collided with an asteroid (line 383), we play a colli- 
sion sound (line 383) and move the offending asteroid out of the way (line 384). Lines 384 
and 385 invoke the ship’s collislon method and deduct 5 extra seconds from the time 
remaining. 

Lines 389-395 check if the player has gotten an energy pack. Line 391-392 invokes 
Rect method colliderect. colliderect returns true if the calling Rect overlaps 
the argument rectstyle. If the player has, indeed, gotten the energy pack, the game plays 
chlmeSound, removes the energy pack and adds 5 seconds to the clock (lines 393-395). 

Lines 398-404 place ali the objects back on the screen, appending their rectangles 
to dirtyRectangles. Lines 407-410 update the clock in the upper-left corner of the 
screen. Function updateClock (lines 196-203) removes the previous clock Surface, 
creates a new one and blits it onto the screen. A pygame. f ont. Font object (line 198) 
allows the program render text into a Surface. The Font constructor takes two argu¬ 
ments. The first is the name of the font file to use. If None is specified, Font will use the 
pygame default font file (bluebold.ttf). The second argument is the size of the font. Line 
198 creates a Font of type bluebold and size 48. Lines 199-200 invoke font’s render 
method to create a new Surface with specified text. render accepts up to four argu¬ 
ments. The first is the text to create. The second specifies to use antialiasing (edge 
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smoothing) or not. The third is the RGB color to render the font in. The fourth is the RGB 
color of the background. If no fourth argument is specified, the text background will be 
transparent. updateClock returns both the old (remove) and new (post) rectangles. 

Once the clock has been created and blitted on the screen, lines 409-410 append the 
clock’s previous rectangle and current rectangle to dirtyRectangles. Line 413 is the 
final step in dirty rectangle animation. Every altered area of the display is updated. Without 
this line, the player would not see any change in the display. Line 414 re-initializes dirt¬ 
yRectangles for the next iteration. 

If the player has crossed the asteroid field (line 417), the program sets courseOver 
to 1. This will ensure the while loop exists after the current iteration. If not, the program 
checks whether the player has run out of time (line 421). If so, the program exits the while 
loop. 

Once the while loop has been broken, execution continues at line 424 and checks if 
the player has won or lost the game. If the player has won, the game plays applau.se- 
Sound and sets message to "Asteroid Field Crossed! Otherwise, the pro¬ 
gram plays gameOverSound and sets message to "Game Over! ". Lines 431—432 
invoke pygame. display function update to display message to the player. Func- 
tion displayMessage returns the rectstyle passed to update. displayMessage 
(lines 187-193) blits a message on the screen and returns the area of the screen which has 
been modified. displayMessage is similar to updateClock. The while loop in 
lines 435-440 waits for the user to exit the program. 


.JnJxl 



Fig. 24.7 Screenshot of Space Cruiser game. 
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24.9 Internet and World Wide Web Resources 




pyopengl. sourceforge.net 

The main Web site of the PyOpenGL module describes the module and provides links to documen- 
tation and the download page. 

www.python.de/pyopengl .html 

The old PyOpenGL module Web site contains information about the earlier versions of the module 
and some examples. 

www.wag.caltech.edu/home/rpm/python_course/Lecture_7.pdf 

This series of lecture slides discussing the interaction between Python and OpenGL. The slides in¬ 
clude a few introductory examples. 

www.opengl.org 

The OpenGL horne page includes a FAQ, downloads, documentation and forums. 
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[***Notes To Reviewers***] 

• We will post this chapter for second-round review with back matter—summary, terminology, ex- 
ercises and Solutions. 

• Please mark your comments in place on a paper copy of the chapter. 

• Please return only marked pages to Deitel & Associates, Inc. 

• Please do not send us e-mails with detailed, line-by-line comments; mark these directly on the pa¬ 
per pages. 

• Please feel free to send any lengthy additional comments by e-mail to cheryl. yaeger@dei- 
tel.net. 

• Please run ali the code examples. 

• Please check that we are using the correct programming idioms. 

• Please check that there are no inconsistencies, errors or omissions in the chapter discussions. 

• The manuscript is being copyedited by a professional copy editor in parallel with your reviews. 
That person will probably find most typos, spelling errors, grammatical errors, etc. 

• Please do not rewrite the manuscript. We are concemed mostly with technical correctness and cor¬ 
rect use of idiom. We will not make significant adjustments to our writing style on a global scale. 
Please send us a short e-mail if you would like to make such a suggestion. 

• Please be constructive. This book will be published soon. We all want to publish the best possible 
book. 

• If you find something that is incorrect, please show us how to correct it. 

• Please read all the back matter including the exercises and any Solutions we provide. 

• Please review the index we provide with each chapter to be sure we have covered the topics you 
feel are important. 
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Objectives 

• To introduce the World Wide Web ConsortiunTs Web 
Content Accessibility Guidelines 1.0 (WCAG 1.0). 

• To understand how to use the ait attribute of the 
<img> tag to describe images to people with visual 
impairments, mobile-Web-device users, search 
engines, etc. 

• To understand how to make XHTML tables more 
accessible to page readers. 

• To understand how to verify that XHTML tags are 
used properly and to ensure that Web pages are 
viewable on any type of display or reader. 

• To understand how VoiceXML™ and CallXML™ are 
changing the way people with disabilities access 
information on the Web. 

• To introduce the various accessibility aids offered in 
Windows 2000. 

’Tis the good reader that makes the good book... 

Ralph Waldo Emerson 



Under 

Constructi on 
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Outline 

25.1 Introduction 

25.2 Web Accessibility 

25.3 Web Accessibility Initiative 

25.4 Providing Alternatives for Images 

25.5 Maximizing Readability by Focusing on Structure 

25.6 Accessibility in XHTML Tables 

25.7 Accessibility in XHTML Frames 

25.8 Accessibility in XML 

25.9 Using Voice Synthesis and Recognition with VoiceXML™ 

25.10 CallXML™ 

25.11 JAWS® for Windows 

25.12 Other Accessibility Tools 

25.13 Accessibility in Microsoft® Windows® 2000 

25.13.1 Tools for People with Visual Impairments 

25.13.2 Tools for People with Hearing Impairments 

25.13.3 Tools for Users Who Have Difficulty Using the Keyboard 

25.13.4 Microsoft Narrator 

25.13.5 Microsoft On-Screen Keyboard 

25.13.6 Accessibility Features in Microsoft Internet Explorer 5.5 

25.14 Internet and World Wide Web Resources 

Summary • Terminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 


25.1 Introduction 

Enabling a Web site to meet the needs of individuals with disabilities is a concern for ali 
businesses. People with disabilities are a significant portion of the population, and legal 
ramifications exist for Web sites that discriminate by not providing adequate and universal 
access to their resources. In this chapter, we explore the Web Accessibility Initiative, its 
guidelines, various laws regarding businesses and their availability to people with disabil¬ 
ities and how some companies have developed systems, products and Services to meet the 
needs of this demographic. 


25.2 Web Accessibility 

In 1999, the National Federation for the Blind (NFB) filed a lawsuit against America On 
Line (AOL) for not supplying access to its Services for people with visual disabilities. The 
Americans with Disabilities Act (ADA) and many other efforts address Web accessibility 
laws (Fig. 25.1). 


© Copyright 1992-2002 by Deitel & Associates, Inc. AII Rights Reserved. 8/29/01 





























pythonhtpl_25.fm Page 1111 Wednesday, August 29, 2001 3:08 PM 


Chapter 25 


Accessibility 1111 


Act Purpose 

Americans with Disabilities Act The ADA prohibits discrimination on the basis of disability 

in employment, state and local government, public accom- 
modations, commercial facilities, transportation and telecom- 
munications. 

The Telecommunications Act of 1996 contains two amend- 
ments to Section 255 and Section 251(a)(2) of the Communi¬ 
cations Act of 1934. These amendments require that 
communication devices, such as cell phones, telephones and 
pagers, be accessible to individuals with disabilities. 
Education materials in schools must be made accessible to 
children with disabilities. 

Section 504 of the Rehabilitation Act States that college 
sponsored activities receiving federal funding cannot dis¬ 
criminate against individuals with disabilities. Section 508 
mandates that ali government institutions receiving federal 
funding design their Web sites such that they are accessible 
to individuals with disabilities. Businesses that Service the 
government also must abide by this act. 


Telecommunications Act of 1996 


Individuals with Disabilities 
Education Act of 1997 
Rehabilitation Act 


Fig. 25.1 Acts designed to protect access to the Internet for people with 
disabilities. 

WeMedia. com'" (Fig. 25.2) is a Web site dedicated to providing news, information, 
products and Services for the millions of people with disabilities, their families, friends and 
caregivers. There are 54 million Americans with disabilities, representing an estimated $1 
trillion in purchasing power. We Media also provides Online educational opportunities for 
people with disabilities. 

The Internet enables individuals with disabilities to work in a vast array of new fields. 
Technologies such as voice activation, visual enhancers and auditory aids, afford more 
employment opportunities. People with visual impairments may use computer monitors 
with enlarged text, while people with physical impairments may use head pointers with on- 
screen keyboards. 

Federal regulations, similar to the disability ramp mandate, will be applied to the 
Internet to accommodate the needs of people with hearing, vision and speech impairments. 
In the following sections, we explore a variety of products and Services that provide 
Internet access for people with disabilities. 


25.3 Web Accessibility Initiative 

On April 7, 1997, the World Wide Web Consortium (W3C) launched the Web Accessibility 
Initiative (WAI™). Accessibility refers to the usability of an application or Web site by peo¬ 
ple with disabilities. The majority of Web sites are considered either partially or totally in- 
accessible to people with visual, learning or mobility impairments. Total accessibility is 
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difficult to achieve because people have varying types of disabilities, language barriers and 
hardware and Software inconsistencies. However, a high level of accessibility is attainable. 
As more people with disabilities use the Internet, it is imperative that Web site designers 
increase the accessibility of their sites. The WAI aims for such accessibility, as discussed 
in its mission statement described at www.w3 .org/WAI. 

This chapter explains some of the techniques for developing accessible Web sites. The 
WAI published the Web Content Accessibility Guidelines (WCAG) 1.0 to help businesses 
determine if their Web sites are accessible to everyone. The WCAG 1.0 (www.w3 .org/ 
TR/WCAG10) uses checkpoints to indicate specific accessibility requirements. Each 
checkpoint has an associated priority indicating its importance. Priority-one checkpoints 
are goals that must be met to ensure accessibility; we focus on these points in this chapter. 
Priority-nvo checkpoints, though not essential, are highly recommended. These check¬ 
points must be satisfied, or people with certain disabilities will experience difficulty 
accessing Web sites. Priority-three checkpoints slightly improve accessibility. 



Fig. 25.2 We Media home page. 
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At the time of this writing, the WAI is working on the WCAG 2.0 draft. A single check- 
point in the WCAG 2.0 Working Draft may encompass several checkpoints from WCAG 
1.0; WCAG 2.0 checkpoints will supersede those in WCAG 1.0. Also, the WCAG 2.0 sup- 
ports a wider range of markup languages (i.e., XML, WML, etc.) and content types than its 
predecessor. To obtain more information about the WCAG 2.0 Working Draft, visit 
www.w3.org/TR/WCAG20. 

The WAI also presents a supplemental checklist of quick tips, which reinforce ten 
important points for accessible Web site design. More information on the WAI Quick Tips 
resides at www.w3 .org/WAI/References/Quicktips. 


25.4 Providing Alternatives for Images 

One important WAI requirement is to ensure that every image on a Web page is accompa- 
nied by a textual description that clearly defines the purpose of the image. To accomplish 
this task, include a text equivalent of each item by using the ait attribute of the <img> 
and <input> tags. A text equivalent for images deftned using the object element is the 
text between the start and end <object> tag. 

Web developers who do not use the ait attribute to provide text equivalents increase 
the difficulty people with visual impairments experience in navigating the Web. Special- 
ized user agents, such as sere en readers (programs that allow users to hear text and text 
descriptions displayed on their screens) and braille displays (devices that receive data from 
screen-reading Software and output the data as braille), allow people with visual impair¬ 
ments to access text-based information displayed on the screen. A user agent visually inter- 
prets Web-page source code and translates it into formatted text and images. Web browsers, 
such as Microsoft Internet Explorer and Netscape Communicator, and the screen readers 
mentioned throughout this chapter are examples of user agents. 

Web pages that do not provide text equivalents for video and audio clips are difficult 
for people with visual and hearing impairments to access. Screen readers cannot read 
images, movies and other non-XHTML objects from these Web pages. Providing multi- 
media-based information in a variety of ways (i.e., using the ait attribute or providing in- 
line descriptions of images) helps maximize the content’s accessibility. 

Web designers should provide useful text equivalents in the ait attribute for use in 
non-visual user agents. For example, if the ait attribute describes a sales growth chart, the 
attribute should provide a brief summary of the data; it should not describe the data in the 
chart. Instead, a complete description of the chart’s data should be included in the long¬ 
desc attribute, which is intended to augment the ait attribute’s description. The long- 
desc attribute contains the URL that links to a Web page describing the image or 
multimedia content. Currently, most Web browsers do not support the longdesc 
attribute. An alternative for the longdesc attribute is D-link, which provides descriptive 
text about graphs and charts. More information on D-links can be obtained at the CORDA 
Technologies Web site (www. corda. com). 

Using a screen reader for Web-site navigation can be time consuming and frustrating, 
as screen readers cannot interpret pictures and other graphical content. A link at the top of 
each Web page that provides direct access to the page’s content allows users to bypass a 
long list of navigation links or other inaccessible elements. This jump can save time and 
eliminate frustration for individuals with visual impairments. 
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Emacspeak is a screen interface that allows greater Internet access to individuals with 
visual disabilities by translating text to voice data. The open source product also imple- 
ments auditory icons that play various sounds. Emacspeak can be customized with Linux 
operating systems and provides support for the IBM ViaVoice speech engine. The Emacs¬ 
peak Web site is located at www.cs.cornell.edu/home/raman/emacspeak/ 
emacspeak.html. 

In March 2001, We Media introduced the “WeMedia Browser,” which allows people 
with poor vision and cognitive disabilities (e.g., dyslexia) to use the Internet more conve- 
niently. The WeMedia Browser /mproves upon the traditional browser by providing over- 
sized buttons and keystroke commands for navigation. The user can control the speed and 
volume at which the browser “reads” Web page text. The WeMedia Browser is available 
for free download at www.wemedia. com. 

IBM Home Page Reader (HPR) is another browser that “reads” text selected by the 
user. The HPR uses the IBM ViaVoice technology to synthesize a voice. A trial version of 
HPR is available at www-3 . ibm.com/able/hpr.html. 


25.5 Maximizing Readability by Focusing on Structure 

Many Web sites use tags for aesthetic purposes rather than for the appropriate purpose. For 
example, the <hl> heading tag often is used erroneously to make text large and bold rather 
than as a major section head for content. The desired visual effect may be achieved, but it 
creates a problem for screen readers. When the screen reader Software encounters the <hl> 
tag, it verbally may inform the user that a new section has been reached when it is not the 
case, which may confuse users. Only use the hl in accordance with its XHTML specifica- 
tions (e.g., as headings to introduce important sections of a document). Instead of using hl 
to make text large and bold, use CSS (discussed in Chapter 28, Cascading Style Sheets) or 
XSL (discussed in Chapter 15, Extensible Markup Language) to format and style the text. 
For further examples, refer to the WCAG 1.0 Web site at www.w3 . org/TR/WCAGlO. 
[Note: The <strong> tag also may be used to make text bold; however, screen readers 
emphasize bold text, which affects the inflection of what is spoken. ] 

Another accessibility issue is readability. When creating a Web page intended for the 
general public, it is important to consider the reading level (i.e., the comprehension and 
level of understanding) at which it is written. Web site designers can make their sites easier 
to read by using shorter words. Designers should also limit slang terms and other non-tra- 
ditional language that may be problematic for users from other countries. 

WCAG 1.0 suggests using a paragraph’s first sentence to convey its subject. Stating 
the point of the paragraph in its first sentence makes its easier to find crucial information 
and allows readers to bypass unwanted material. 

The Gunning Fog Index , a formula that produces a readability grade when applied to 
a text sample, evaluates a Web site’s readability. More information about the Gunning Fog 
Index can be obtained at www. trainingpost .org/3-2-inst.htm. 


25.6 Accessibility in XHTML Tables 

Complex Web pages often contain tables for formatting content and presenting data. Many 
screen readers are incapable of translating tables correctly unless the tables are properly de- 
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signed. For example, the CAST eRecider, a screen reader developed by the Center for Ap¬ 
plied Special Technology (www.cast.org), starts at the top-left-hand cell and reads 
columns from top to bottom, left to right. This procedure is known as reading a table in a 
linearized manner. The CAST eReader reads the table in Fig. 25.3 as follows: 

Price of Fruit Fruit Price Apple $0.25 Orange $0.50 Banana 
$1.00 Pineapple $2.00 


1 

<?xml version = "1.0‘?> 


2 

< l DOCTYPE html PUBLIC " - / /W3C/ /DTD XHTML 1.0 Striet 


3 


td" > 

4 



5 

<!-- Fig. 25.3: withoutheaders.html --> 


6 

<!-- Table without headers --> 


7 



8 

<html> 


9 

<head> 


10 

<title XHTML Table Without Headers </title> 


11 



12 

<style type = "text/css"> 


13 

body { background-color : ;cffa< ; 


14 

text-align: cent } 


15 

</style> 


16 

</head> 


17 



18 

<body> 


19 



20 

<p>Price of Fruit</p> 


21 



22 

<table border = width = > 


23 



24 

<tr> 


25 

<td>Fruit</td> 


26 

<td>Price</td> 


27 

</tr> 


28 



29 

<tr> 


30 

<td>Apple</td> 


31 

<td>$0 . 25</td> 


32 

</tr> 


33 



34 

<tr> 


35 

<td>Orange</td> 


36 

<td>$0 . 50</td> 


37 

</tr> 


38 



39 

<tr> 


40 

<td Banana /td> 


41 

<td>$l.00</td> 


42 

</tr> 


43 




Fig. 25.3 XHTML table without accessibility modifications (part 1 of 2). 
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44 <tr> 

<td>Pineapple</td> 

46 <td>$2 . 00</td> 

47 </tr> 

48 

49 </table> 

50 

51 </body> 

52 </html> 



Fig. 25.3 XHTML table without accessibility modifications (part 2 of 2). 

This reading does not present the content of the table adequately. WCAG 1.0 recom- 
mends using CSS instead of tables, unless the tables’ content linearizes in an understand- 
able manner. 

If the table in Fig. 25.3 were large, the screen reader’s linearized reading would be 
even more confusing to users. By modifying the <td> tag with the headers attribute and 
modifying header cells (cells specified by the <th> tag) with the id attribute, a table will 
be read as intended. Figure 25.4 demonstrates how these modifications change the way a 
table is interpreted. 

This table does not appear to be different from a Standard XHTML table. However, the 
table is read in a more intelligent manner, when using a screen reader. A screen reader 
vocalizes the data from the table in Fig. 25.4 as follows: 

Caption: Price of Eruit 

Summary: This table uses th and the id and headers attributes 
to make the table readable by screen readers. 

Eruit: Apple, Price: $0.25 
Eruit: Orange, Price: $0.50 
Eruit: Banana, Price: $1.00 
Eruit: Pineapple, Price: $2.00 

Every cell in the table is preceded by its corresponding header when read by the screen 
reader. This format helps the listener understand the table. The headers attribute is 


4 - 
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intended specifically for tables that hold large amounts of data. Most small tables linearize 
well as long as the <th> tag is used properly. The summary attribute and the caption 
element are also suggested. For more examples demonstrating how to make tables acces- 
sible, visit www.w3 .org/TR/WCAG. 


1 

<?xml version = 




2 

<!DOCTYPE html PUBLIC 




3 



> 


4 





5 

<!-- Fig. 25.4: withheaders 

.html --> 



6 

7 

<!-- Table with headers 

--> 



8 

<html> 




9 

<head> 




10 

11 

<title XHTML Table With Headers</title> 



12 

<style type = "text/c 

ss"> 



13 

body { background- 

color: ; 



14 

text-align: 

} 



15 

</style> 




16 

</head> 




17 





18 

<body> 




19 





20 

<!— this table uses the 

id and headers attributes 

to 

-> 

21 

<!-- ensure readability 

by text-based browsers. It 

also - 

-> 

22 

<!-- uses a summary attribute, used screen readers 

to 

-> 

23 

<!-- describe the table 


- 

-> 

24 





25 

<table width = "50V 

border = '1" 



26 

summary = "This ta 




27 





28 


> 



29 





30 

<captionxstrong>Price of Fruit</strongx/caption> 


31 





32 

<tr> 




33 

<th id = "fruit 

>Fruit</th> 



34 

<th id = 'prica 

>Price</th> 



35 

</tr> 




36 





37 

<tr> 




38 

<td headers = 

Apple</td> 



39 

<td headers = 

>$0 .25</td> 



40 

</tr> 




41 





42 

<tr> 




43 

<td headers = 

>Orange /td> 



44 

<td headers = 

>$0. 50</td> 



45 

</tr> 




46 






Fig. 25.4 Table optimized for screen reading using attribute headers (part 1 of 2). 


© Copyright 1992-2002 by Deitel & Associates, Inc. AII Rights Reserved. 8/29/01 





























pythonhtpl_25.fm Page 1118 Wednesday, August 29, 2001 3:08 PM 



1118 

Accessibility 


47 

<tr> 


48 

<td headers = 

>Banana</td> 

49 

<td headers = "pr 

>$1.00</td> 

50 

</tr> 


51 



52 

<tr> 


53 

<td headers = "fr 

>Pineapple</td> 

54 

<td headers = "pr 

>$2. 00</td> 

55 

</tr> 


56 



57 

</table> 


58 



59 

</body> 


60 </html> 



Chapter 25 



Fig. 25.4 Table optimized for screen reading using attribute headers (part 2 of 2). 


25.7 Accessibility in XHTML Frames 


Web designers often use frames to display more than one XHTML file in a single browser 
window. Frames are a convenient way to ensure that certain content always displays on the 
screen. Unfortunately, frames often lack proper descriptions, which prevents users with 
text-based browsers, or users listening with speech synthesizers, from navigating the Web 
site. 

A site with frames must have meaningful descriptions in the <title> tag for each 
frame. Examples of good tities include “Navigation Frame ” and “Main Content Frame.” 
Users with text-based browsers, such as Lynx, must choose which frame they want to open; 
descriptive tities make this choice simpler. However, assigning tities to frames does not 
solve ali the navigation problems associated with frames. The <noframes> tag allows 
Web designers to offer alternative content for browsers that do not support frames. 



Good Programming Practice 25.1 

Always provide tities for frames to ensure that user agents which do not support frames have 
alternatives. 


4 ^- 
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Good Programming Practice 25.2 

Include a titlefor each frcime’s contents with the frame element, and, ifpossible, provide 
links to the individual pages within the frameset so that users stili can navigate through the 
Web pages. To provide access to browsers that do not support frame s, use the <noframes> 
tag. It also provides better access to browsers that have limited support. 


WCAG 1.0 suggests using Cascading Style Sheets (CSS) as an alternative to frames, 
because CSS provides similar functionality and are highly customizible. Unfortunately, the 
ability to display multiple XHTML documents in a single browser window requires the 
complete support of HTML 4, which is not widespread. However, the second generation of 
Cascading Style Sheets (CSS2) displays a single document as if it were several documents. 
However, CSS2 is not yet fully supported by many user agents. 


25.8 Accessibility in XML 

XML allows developers to create new markup languages, which may not necessarily incor¬ 
porate accessibility features. To prevent the proliferation of inaccessible languages, the 
WAI is developing guidelines—the XML Guidelines (XML GL) —for creating accessible 
XML documents. The XML GL recommends including a text description, similar to XHT- 
ML’s <alt> tag, for each non-text object on a page. To facilitate accessibility further, el¬ 
ement types should allow grouping and classification and should identify important 
content. Without an accessible user interface, other efforts to implement accessibility are 
less effective, so it is essential to create XSLT or CSS style sheets that can produce multiple 
outputs, including document outlines. 

Many XML languages, including Synchronized Multimedia Integration Language 
(SMIL) and Scalable Vector Graphics (SVG), implement several of the WAI guidelines. 
The WAI XML Accessibility Guidelines can be found at www.w3.org/WAI/PF/ 
xmlgl. htm. 


25.9 Using Voice Synthesis and Recognition with VoiceXML™ 

A joint effort by AT&T®, IBM®, Lucent™ and Motorola® has created an XML vocabulary 
that marks up information for speech synthesizers, which enable computers to speak to us¬ 
ers. This technology, called VoiceXML , has tremendous implications for people with visual 
impairments and for the illiterate. VoiceXML-enabled applications read Web pages to the 
user and understand words spoken into a microphone through speech recognition technol¬ 
ogy. An example of a speech recognition tool is IBM’s ViaVoice (www-4.ibm.com/ 
Software/speech). 

A VoiceXML interpreter and VoiceXML browser process VoiceXML, a platform- 
independent XML-based technology. Web browsers may incorporate these interpreters in 
the future. When a VoiceXML document is loaded, a voice ser\>er sends a message to the 
VoiceXML browser and begins a conversation between the user and the computer. 

IBM WebSphere Voice Server SDK 1.5 is a VoiceXML interpreter that tests 
VoiceXML documents on a desktop computer. To download the VoiceServer SDK, visit 
www.alphaworks.ibm.com/tech/voiceserversdk. [Note: To run the 
VoiceXML program in Fig. 25.5, download Java 2 Platform Standard Edition (Java SDK) 
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1.3 from www. java. sun.com/j2se/l. 3. To obtain installation instructions for the 
VoiceServer SDK and the Java SDK, visit the Deitel & Associates, Inc. Web site at 

www.deitel .eam.] 

Figure 25.5and Fig. 25.6 show examples of VoiceXML that would be appropriate for 
a Web site. The document’s text is spoken to the user, and the text embedded in the 
VoiceXML tags allows for interactivity between the user and the browser. The output 
included in Fig. 25.6 demonstrates a conversation that might take place between a user and 
a computer after loading this document. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 


e?xml version = "1.0"?> 
evxml version = "1.0"> 

<!-- Fig. 25.5: main.vxml --> 
<!— Voice page --> 

<link next = '#home"> 

egrammar>homee /grammar> 
e/link> 

elink next = > 

<grammar >exit </grammar> 
</link> 


<var name = "currentOption" expr = "'home'”/> 

<form> 

<block> 

<emp>Welcome </emp> to the voice page of Deitel and 
Associates. To exit any time say exit. 

To go to the home page any time say horne. 

</block> 

<subdialog src = #ho: /> 

</form> 


<menu id = "home"> 

<prompt count = timeout = '10s" > 

You have just entered the Deitel home page. 
Please make a selection by speaking one of the 
following options: 

<break msecs = 100" /> 

<enumerate/> 

</prompt> 


<prompt count = ' 2 ' > 

Please say one of the following. 

<break msecs = 1000" /> 

<enumerate/> 

</prompt> 


echoice next 
echoice next 


About use/choice> 

>Driving directionse/choice> 


Fig. 25.5 Home page written in VoiceXML (part 1 of 3). 
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43 <choice next = Publications</choice> 

44 </menu> 

45 

46 <form id = "about"> 

47 <block> 

48 About Deitel and Associates, Inc. 

Deitel and Associates, Inc. is an internationally 
recognized corporate training and publishing organization, 
specializing in programming languages. Internet and World 
Wide Web technology and object technology education. 

Deitel and Associates, Inc. is a member of the World Wide 
Web Consortium. The company provides courses on Java, C++, 
Visual Basic, C, Internet and World Wide Web programming 

56 and Object Technology. 

57 <assign name = "currentOption" expr = " ibov /> 

58 <goto next = "#repeat"/> 

59 </block> 

60 </form> 

61 

62 <form id = "directione > 

63 <block> 

Directions to Deitel and Associates, Inc. 

65 We are located on Route 20 in Sudbury, 

66 Massachusetts, eguidistant from route 

<sayas class = "digits">128</sayas> and route 

68 <sayas class = "digits">495</sayas>. 

69 <assign name = "currentOption" expr = "'directions 1 " /> 

70 <goto next = '#repeat /> 

71 </block> 

72 </form> 

73 

74 <form id = 

75 <field name = 

76 <prompt> 

To repeat 

78 </prompt> 

79 

80 <filled> 

81 <if cond 

82 <goto 

83 <else/> 

84 <goto n 

85 </if> 

86 </filled> 


87 



88 

</field> 


89 

</form> 


90 



91 

<form id = 

> 

92 

<block> 


93 

Thank you 

for visiting Deitel and Associates voice page 

94 

Have a nice day. 

95 

<exit/> 



Fig. 25.5 Home page written in VoiceXML (part 2 of 3). 


:onfirm" type = "boolean"> 

say yes. To go back to horne, say no. 


expr = 
ext = 


/> 


/> 
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75 </block> 

97 </form> 

98 

99 </vxml> 


Fig. 25.5 Home page written in VoiceXML (part 3 of 3). 

A VoiceXML document contains a series of dialogs and subdialogs, which resuit in 
spoken interaction between the user and the computer. The <form> and <menu> tags 
implement the dialogs. A form element presents information and gathers data from the 
user. A menu element provides users with options and transfers control to other dialogs, 
based on users’ selections. 

Lines 7-9 use element link to create an active link to the horne page. Attribute next 
specifies the URI navigated to when the link is selected. Element grammar marks up the 
text that the user must speak to select the link. In the link element, we navigate to the ele¬ 
ment with id home when users speak the word home. Lines 11-13 use element link to 
create a link to id end when users speak the word exit. 

Lines 17-24 create a form dialog using element form, which collects information 
from the user. Lines 18-22 present introductory text. Element block, which can exist only 
within a form element, groups elements that perform an action or an event. Element emp 
States that a section of text should be spoken with emphasis. If the level of emphasis is not 
specified, then the default level— moderate —is used. Our example uses the default level. 
[Note: To specify an emphasis level, use the level attribute. This attribute accepts the fol- 
lowing values: strong, moderate, none and reduced.] 


1 <?xml version = ?> 

2 <vxml version = "1.0"> 

3 

4 <!-- Fig. 25.6: pubiications.vxml --> 

5 <! — Voice page for various publications --> 

6 

7 <link next = "main.vxmltthome" > 

8 <grammar>home</grammar> 

9 </link> 

10 clink next = > 

11 <grammar>exit</grammar> 

12 </link> 

13 clink next = > 

14 <grammar>menu</grammar> 

15 </link> 

16 

17 cvar name = expr = /> 

18 

19 cmenu id = > 

20 

21 cprompt count = timeout = > 

Following are some of our publications. For more 
information visit our web page at www.deitel.com. 

To repeat the following menu, say menu at any time. 

Fig. 25.6 Publication page of DeiteLs VoiceXML page (part 1 of 4). 


4 ^ 
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~25 


Please select by saying one of the following books: 


26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 


cbreak msecs = "1000" /> 
<enumerate/> 

</prompt> 


<prompt count = " 2" > 

Please select from the following books. 

cbreak msecs = "1000" /> 

<enumerate/> 

</prompt> 


echoice next 
echoice next 
echoice next 
e/menu> 


>Java.e/choice> 

>C.e/choice> 

>C plus plus. e/choice> 


eform id = java"> 
eblock> 

Java How to program, third edition. 

The complete, authoritative introduction to Java. 

Java is revolutionizing Software development with 
multimedia-intensive, platform-independent, 
object-oriented code for conventional. Internet, 
Intranet and Extranet-based applets and applications. 
This Third Edition of the world's most widely used 
university-level Java textbook carefully explains 
Java's extraordinary capabilities. 
eassign name = "currentOption" expr = '"‘java'"/» 
egoto next = #repeat' /> 
e/block> 
c/form> 


eform id = "c"> 
eblock> 

C How to Program, third edition. 

This is the long-awaited, thorough revision to the 
world's best-selling introductory C book! The book's 
powerful "teach by example" approach is based on 
more than 10,000 lines of live code, thoroughly 
explained and illustrated with screen captures showing 
detailed output.World-renowned corporate trainers and 
best-selling authors Harvey and Paul Deitel offer the 
most comprehensive, practical introduction to C ever 
published with hundreds of hands-on exercises, more 
than 250 complete programs written and documented for 
easy learning, and exceptional insight into good 
programming practices, maximizing performance, avoiding 
errors, debugging, and testing. New features include 
thorough introductions to C++, Java, and object-oriented 
programming that build directly on the C skills taught 
in this book; coverage of graphical user interface 
development and C library functions; and many new, 
substantial hands-on projects.For anyone who wants to 


Fig. 25.6 Publication page of DeiteFs VoiceXML page (part 2 of 4). 
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learn C, improve their existing C skills, and understand 
how C serves as the foundation for C++, Java, and 


80 

81 

82 

83 

84 

85 

86 

87 

88 

89 

90 

91 

92 

93 

94 

95 

96 

97 

98 

99 

100 
101 
102 

103 

104 

105 

106 

107 

108 

109 

110 
111 
112 

113 

114 

115 

116 

117 

118 

119 

120 
121 
122 

123 

124 

125 

126 

127 

128 

129 

130 


object-oriented development. 

<assign name = "currentOption" expr = "'c' /> 

<goto next = itrepeat /> 

</block> 

</form> 

<form id = "cplus“> 

<block> 

The C++ how to program, second edition. 

With nearly 250,000 sold, Harvey and Paul Deitel 1 s C++ 

How to Program is the world's best-selling introduction 
to C++ programming. Now, this classic has been thoroughly 
updated! The new, full-color Third Edition has been 
completely revised to reflect the ANSI C++ Standard, add 
powerful new coverage of object analysis and design with 
UML, and give beginning C++ developers even better live 
code examples and real-world projects. The Deitels' C++ 
How to Program is the most comprehensive, practical 
introduction to C++ ever published with hundreds of 
hands-on exercises, roughly 250 complete programs written 
and documented for easy learning, and exceptional insight 
into good programming practices, maximizing performance, 
avoiding errors, debugging, and testing. This new Third 
Edition covers every key concept and technique ANSI C++ 
developers need to master: control structures, functions, 
arrays, pointers and strings, classes and data 
abstraction, operator overloading, inheritance, virtual 
functions, polymorphism, I/O, templates, exception 
handling, file Processing, data structures, and more. It 
also includes a detailed introduction to Standard 
Template Library containers, Container adapters, 
algorithms, and iterators. 

<assign name = expr = /> 

<goto next = #repeat /> 

</block> 

</form> 

<form id = "repeat 1 > 

<field name = "confi type = "bool > 

<prompt> 

To repeat say yes. Say no, to go back to horne. 

</prompt> 

<filled> 

<if cond = "confirm == true"> 

<goto expr = + currentOption' /> 

<else/> 

<goto next = "#publication" /> 

</if > 

</filled> 


Fig. 25.6 Publication page of Deitel's VoiceXML page (part 3 of 4). 
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TTI </field> 

132 </form> 

133 </vxml> 


Computer: 

Welcome to the voice page of Deitel and Associates. To 
say exit. To go to the horne page any time say horne. 

exit any time 

User: 

Home 


Computer: 

You have just entered the Deitel horne page. Please make a selection by 
speaking one of the following options: About us, Driving directions, 
Publications. 

User: 

Driving directions 


Computer: 

Directions to Deitel and Associates, Inc. 

We are located on Route 20 in Sudbury, 

Massachusetts, equidistant from route 128 
and route 495. 

To repeat say yes. To go back to horne, say no. 



Fig. 25.6 Publication page of Deitefs VoiceXML page (part 4 of 4). 


The menu element on line 26 enables users to select the page to which they would like 
to link. The choice element, which is always part of either a menu or a f orm, presents 
the options. The next attribute indicates the page to be loaded when a user makes a selec- 
tion. The user selects a choice element by speaking the text marked up between the tags 
into a microphone. In this example, the first and second choice elements on lines 41-42 
transfer control to a local dialog (i.e., a location within the same document) when they are 
selected. The third choice element transfers the user to the document publica- 
tions. vxral. Lines 27-33 use element prompt to instruet the user to make a selection. 
Attribute count maintains the number of times a prompt is spoken (i.e., each time a 
prompt is read, count increments by one). The count attribute transfers control to 
another prompt once a certain limit has been reached. Attribute timeout specifies how 
long the program should wait after outputting the prompt for users to respond. In the event 
that the user does not respond before the timeout period expires, lines 35-39 provide a 
second, shorter prompt to remind the user to make a selection. 

When the user chooses the publications option, the publications. vxml 
(Fig. 25.6) loads into the browser. Lines 106-111 define link elements that provide links 
tomain. vxml. Lines 112-114 provide links to the menu element (lines 118-138), which 
asks users to select one of the publications: Java, C or C++. The form elements on lines 
140-214 describe each of the books on these topies. Once the browser speaks the descrip- 
tion, control transfers to the form element with an id attribute that has a value equal to 
repeat (lines 216-231). 
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Figure 25.6 provides a brief descriptiori of each VoiceXML tag used in the previous 
example (Fig. 25.6). 


VoiceXML Tag 

Description 

<assign> 

Assigns a value to a variable. 

<block> 

Presents information to users without any interaction between the user and 
the computer (i.e., the computer does not expect any input from the user). 

<break> 

Instmcts the computer to pause its speech output for a specified period of 
time. 

<choice> 

Specifies an option in a menu element. 

<enumerate> 

Lists ali the available options to the user. 

<exit> 

Exits the program. 

<filled> 

Contains elements to be executed when the computer receives user input for a 
f orm element. 

<f orm> 

Gathers information from the user for a set of variables. 

<goto> 

Transfers control from one dialog to another. 

<grairanar> 

Specifies grammar for the expected input from the user. 

<if >, 

<else>, 

<elseif> 

Control statements used for making logic decisions. 

<link> 

A transfer of control similar to the goto statement, but a link can be exe¬ 
cuted at any time during the progranfs execution. 

<menu> 

Provides user options and transfers control to other dialogs, based on the 
selected option. 

<prompt> 

Specifies text to be read to the user when a selection is needed. 

<subdialog> 

Calis another dialog. After executing the subdialog, the calling dialog 
resumes control. 

<var> 

Declares a variable. 

<vxml> 

The top-level tag specifying that the document should be processed by a 
VoiceXML interpreter. 


Fig. 25.7 Some VoiceXML tags. 



25.10 CallXML™ 

Another advancement in voice technology for people with visual impairments is CallXML, 
a technology created and supported by Voxeo (www.voxeo.com). CallXML creates 
phone-to-Web applications that control incoming and outgoing telephone calls. Some ex- 
amples of CallXML applications include voice mail, interactive voice response systems 
and Internet call waiting. While VoiceXML assists individuals with visual impairments by 
reading Web pages, CallXML provides individuals with visual impairments access to Web- 
based content through telephones. 
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When users access CallXML applications, a text-to-speech (TTS) engine reads Infor¬ 
mation contained within CallXML elements. A TTS engine converts text to an automated 
voice. Web applications respond to the caller’s input. [Note: A touch-tone phone is required 
to access CallXML applications.] 

Typically, CallXML applications play pre-recorded audio clips or text as output, 
requesting a response as input. An audio clip may contain a greeting that introduces callers 
to the application or to a menu of options that requires callers to make touch-tone entries. 
Certain applications, such as voice mail, may require verbal and touch-tone input. Once the 
input is received, the application responds by invoking CallXML elements such as text, 
which contains the information a TTS engine reads to users. If the application does not 
receive input within a designated time frame, it prompts the user to enter valid input. 

When a user accesses a CallXML application, the incoming telephone call is referred 
to as a session. A CallXML application can support multiple sessions, enabling the appli¬ 
cation to receive multiple telephone calls simultaneously. Each session is independent of 
the others and is assigned a unique sessionlD for identification. A session terminates either 
when the user hangs up the telephone or when the CallXML application invokes the 
hangup element. Our first CallXML example shows the classic Helio World example 
(Fig. 25.8). 


1 <?xml version = encoding = ?> 

2 

3 <I — Fig. 25.8: hello.xml --> 

4 <!-- The classic Helio World example --> 

5 

6 <callxml> 

ctext Helio World. </text> 

8 </callxml> 


4 - 



Fig. 25.8 Helio World CallXML example. 
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Line 1 contains the optional XML declarationi alue version indicates the XML 
version to which the document conforms. Currently, this is version = 1.0. Value 
encoding indicates the type of Unicode encoding to use. This example uses UTF-8, 
which requires eight bits to transfer and receive data. More information on Unicode may 
be found in Appendix G, Unicode®. 

The <callxml> tag on line 6 declares the contents of a CallXML document. Line 7 
contains the Helio World text. Ali text spoken by a text-to-speech (TTS) engine needs 
to reside within <text> tags. 

To deploy a CallXML application, register with the Voxeo Community (commu- 
nity. voxeo. com), a Web resource for creating, debugging and deploying phone appli- 
cations. For the most part, Voxeo is a free Web resource. However, the company charges 
fees when CallXML applications are deployed commercially. The Voxeo Community 
assigns a unique telephone number to each CallXML application so that external users may 
access and interact with the application. [Note: Voxeo assigns telephone numbers to appli¬ 
cations that reside on the Internet. If you have access to a Web server (IIS, PWS, Apache, 
etc.), use it to post your CallXML application. Otherwise, open an Internet account using 
one of the many Internet-Service companies (e.g., www.geocities.com, 
www.angelf ire.com). These companies allow you to post documents on the Internet 
by using their Web servers.] 

Figure 25.8 demonstrates the logging feature of the Voxeo Account Manager, 
which is accessible to registered members. The logging feature records and displays the 
“conversation” between the user and the application. The first row of the logging feature 
displays the URL of the CallXML application and the global variables associated with each 
session. The application (program) creates and assigns values to global variables, which the 
entire application can access and modify, at the start of each session. The subsequent row(s) 
display(s) the “conversation.” This example shows a one-way conversation (because the 
application does not accept any input from the user) in which the TTS says Helio World. 
The last row shows the end of session message, which States that the phone call has ter- 
minated. The logging feature assists developers in debugging their applications. By 
observing the “conversation,” a developer can determine at which point the application ter- 
minates. If the application terminates abruptly (“crashes”), the logging feature States the 
type and location of the error, so that a developer knows the particular section of the appli¬ 
cation on which to focus. 

The next example (Fig. 25.9) shows a CallXML application that reads the ISBN values 
of three Deitel textbooks— Internet and World Wide Web How to Program: Second Edi- 
tion, XML How to Program and Java How to Program: Fourth Edition —based on the 
user’s touch-tone input. [Note: The following code has been formatted for presentation pur- 
poses.] 


1 <?xml version = encoding = ?> 

2 

3 <!-- Fig. 25.9: isbn.xml --> 

4 <I — Reads the ISBN value of three Deitel books --> 

5 

6 <callxml> 

Fig. 25.9 CallXML example that reads three ISBN values (part 1 of 3). 
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— 7 <block> 

8 <text> 

Welcome. To obtain the ISBN of the Internet and World 
Wide Web How to Program: Second Edition, please enter 1. 
To obtain the ISBN of the XML How to Program, 


12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 


please enter 2. To obtain the ISBN of the Java How 
to Program: Fourth Edition, please enter 3. To exit the 
application, please enter 4. 

</text> 

<!-- obtains the numeric value entered by the user and --> 
<!-- Stores it in the variable ISBN. The user has 60 --> 

<!-- seconds to enter one numeric value --> 

<getDigits var = "ISBN" 
maxDigits = "1" 
termDigits = "1234" 
maxTime = '60s‘ /> 

<!-- requests that the user enter a valid numeric --> 

<!-- value after the elapsed time of 60 seconds --> 
<onMaxSilence> 

<text> 

Please enter either 1, 2, 3 or 4. 

</text> 

<getDigits var = "ISBN" 
termDigits = "1234" 
maxDigits = "1" 
maxTime = '60s /> 

</onMaxSilence> 

<onTermDigit value = > 

<text> 

The ISBN for the Internet book is 0130308978. 

Thank you for calling our CallXML application. 
Good-bye. 

</text> 

</onTermDigit> 

<onTermDigit value = "2" > 

<text> 

The ISBN for the XML book is 0130284173. 

Thank you for calling our CallXML application. 
Good-bye. 

</text> 

</onTermDigit> 

<onTermDigit value = > 

<text> 

The ISBN for the Java book is 0130341517. 

Thank you for calling our CallXML application. 
Good-bye. 


Fig. 25.9 CallXML example that reads three ISBN values (part 2 of 3). 
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"50 </text> 

61 </onTermDigit> 

62 

63 <onTermDigit value = "4"> 


64 

65 

66 

67 

68 

69 

70 

71 

72 

73 


<text> 

Thank you for calling our CallXML application. 
Good-bye. 

</text> 

</onTermDigit> 

</block> 

<!-- event handler that terminates the call --> 
•conHangup /> 

</callxml> 


'3 Voxeo Account Manager - Microsoft Internet Explorer 


JfljxJ 


— Logging 


IIemb wmm\ 



d 


Session ID Time (h:m:s) Aetion 


Logging started, waiting for call 

00000000236 03:44:13.972 PM goto value=" http://www. buq2buq.com/isbn.xml 11 

submit="callerID=6175557444 calledID=3475550110 
session.accountid=2992 session.calledid=3475550110 
session. callerid=6175557444 

session. id=e4bea3fl03d96b4bb6dcbf59239ac265-236 
session.ttsdisplayname=English-Malel session. ttsengine=Fonix 
session.ttslanguage=English session.ttsvoice=Malel" method="get" 
cache-" 


00000000236 

03:44:15.456 PM 

text TTS="Welcome. To obtain the ISBN of the Internet and World 
Wide Web How to Program: Second Edition, please enter 1. To obtain 
the I S B N of the X M L How to Program, please enter 2. To obtain the 

I S B N of the Java How to Program: Fourth Edition, please enter 3. To 
exit the application, please enter 4." format="connected" termDigits-" 1 
clearDigits=0 

00000000236 

03:44:40.518 PM 

getDigits termDigits="1234" var-TSBN" maxDigits=l includeTermDigit=0 
clearDigits=0 maxTime=60000 maxSilence=5000 

00000000236 

03:44:40.972 PM 

termdigit "1" 

00000000236 

03:44:40.972 PM 

text TTS="The I S B N for the Internet book is 013030897 8. 
Thank you for calling our Call X M L application. Good-bye." 
format="connected" termDigits- 1 " clearDigits=0 

00000000236 

03:44:52.081 PM 

end of session 


m 


$ Internet 


4 - 


Fig. 25.9 CallXML example that reads three ISBN values (part 3 of 3). 

The <block> tag (line 7) encapsulates other CallXML tags. Usually, CallXML tags 
that perform a similar task should be enclosed within <block>...</block>. The block 
element in this example encapsulates the <text>, <getDigits>, <onMaxSilence> 
and <onTermDigit> tags. A block element can contain nested block elements. 

Lines 20-23 show some attributes of the <getDigits> tag. The getDigits ele¬ 
ment obtains the user’s touch-tone response and Stores it in the variable declared by the 
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var attribute (i.e., ISBN). The maxDigits attribute (line 21) indicates the maximum 
number of digits that the application can accept. This application accepts only one char¬ 
acter. If no number is stated, then the application uses the default value— nolimit. 

The termDigits attribute (line 22) contains the list of characters that terminate user 
input. When a character from this list is received as input, the CallXML application is noti- 
fied that the last acceptable input has been received and that any character entered after this 
point is invalid. These characters do not terminate the call; they simply notify the applica¬ 
tion to proceed to the next step because the necessary input has been received. In our 
example, the values for tenrLDigits are one, two, three or four. The default value for 
tenrLDigits is the null value (" ")■ 

The maxTime attribute (line 23) indicates the maximum amount of time to wait for a 
user response (i.e., 60 seconds). If no input is received within the given time frame, then 
the CallXML application may terminate—a drastic measure. The default value for this 
attribute is 30 seconds. 

The onMaxSilence element (lines 27-37) is an event handler that is invoked when 
the maxTime (or maxSilence) expires. An event handler notifies the application of the 
appropriate action to perform. In this case, the application asks the user to enter a value 
because the maxTime has expired. After receiving input, getDigits (line 32) Stores the 
value in the ISBN variable. 

The onTermDigit element (lines 39-68) is an event handler that notifies the appli¬ 
cation of the appropriate action to perform when users select one of the tenrLDigits 
characters. At least one <onTermDigit> tag must be associated with the getDigits 
element, even if the default value (" ") is used. We provide four actions that the application 
can perform depending on the user-entered value. For example, if the user enters 1, the 
application reads the ISBN value of the Internet and World Wide Web How to Program: 
Second Edition textbook. 

Line 72 contains the <onHangup/> event handler, which terminates the telephone 
call when the user hangs up the telephone. Our <onHangup> event handler is an empty 
tag (i.e., there is no action to perform when this tag is invoked). 

The logging feature in Fig. 25.9 displays the “conversation” between the application 
and the user. The first row displays the URL of the application and the global variables of 
the session. The subsequent rows display the “conversation”—the application asks the 
caller which ISBN value to read, the caller enters 1 ( Internet and World Wide Web How to 
Program: Second Edition) and the application reads the corresponding ISBN. The end of 
session message States that the application has terminated. 

Brief descriptions of several logic and action CallXML elements are provided in 
Fig. 25.10. Logic elements assign values to, and ciear values from, the session variables, 
and action elements perform specified tasks, such as answering and terminating a telephone 
call during the current session. A complete list of CallXML elements is available at: 

www.oasis-open.org/cover/callxmlv2 .html 
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25.11 JAWS® for Windows 

JAWS (Job Access with Sound) is one of the leading screen readers on the market today. 
Henter-Joyce, a division of Freedom Scientific™, created this applicatiori to help people 
with visual impairments use technology. 

To download a demonstration version of JAWS, visit www.hj.com/JAWS/ 
JAWS37DemoOp.htm and select the JAWS 3.7 FREE Demo link. The demo expires 
after 40 minutes. The computer must be rebooted before another 40-minute session can be 
started. 


Elements 

Description 

assign 

Assigns a value to a variable, var. 

ciear 

Clears the contents of the var attribute. 

clearDigits 

Clears all digits that the user has entered. 

goto 

Navigates to another section of the current CallXML application or 
to a different CallXML application. The value attribute speciftes 
the application URL. The submit attribute lists the variables that 
are passed to the invoked application. The method attribute States 
whether to use the HTTP gei or post request types when sending 
and retrieving information. A get request retrieves data from a Web 
server without modifying the contents, while the post request sends 
modified data. 

run 

Starts a new CallXML session for each call. The value attribute 
specifies which CallXML application to retrieve. The submit 
attribute lists the variables that are passed to the invoked applica¬ 
tion. The method attribute States whether to use the HTTP get or 
post request type. The var attribute Stores the identification num- 
ber of the session. 

sendEvent 

Allows multiple sessions to exchange messages. The value 
attribute Stores the message, and the session attribute specifies 
the identification number of the session that receives the message. 

answer 

Answers an incoming telephone call. 

call 

Calis the URL specified by the value attribute. The callerlD 
attribute contains the phone number that is displayed on a CallerlD 
device. The maxTime attribute specifies the length of time to wait 
for the call to be answered before disconnecting. 

conference 

Connects multiple sessions so that people can participate in a con- 
ference call. The targetSessions attribute specifies the iden¬ 
tification numbers of the sessions, and the termDigits attribute 
indicates the touch-tone keys that terminate the call. 

wait 

Waits for user input. The value attribute specifies how long to 
wait. The termDigits attribute indicates the touch-tone keys 
that terminate the wait element. 


Fig. 25.10 List of some CallXML elements (part 1 of2), 
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Elements 

Description 

play 

Plays an audio file or a value that is stored as a number, date or 
amount of money and is indicated by the format attribute. The 
value attribute contains the information (location of the audio 
file, number, date or amount of money) that corresponds to the 
format attribute. The clearDigits attribute specifies whether 
or not to delete the previously entered input. The termDigits 
attribute indicates the touch-tone keys that terminate the audio file. 


etc. 

recordAudio 

Records an audio file and Stores it at the URL specified by value. 
The format attribute indicates the file extension of the audio clip. 
Other attributes include termDigits, clearDigits, max- 
Time and maxSilence. 


Fig. 25.10 List of some CallXML elements (part 2 of 2), 


The JAWS demo is fully functional and includes an extensive, highly customized help 
system. Users can select which voice to use and the rate at which text is spoken. Users also 
can create keyboard shortcuts. Although the demo is in English, the full version of JAWS 
3.7 allows the user to choose one of several supported languages. 

JAWS also includes special key commands for popular programs such as Microsoft 
Internet Explorer and Microsoft Word. For example, when browsing in Internet Explorer, 
JAWS’ capabilities extend beyond reading the content on the screen. If JAWS is enabled, 
pressing Insert + F7 in Internet Explorer opens a Links List dialog, which displays ali the 
links available on a Web page. For more information about JAWS and the other products 
offered by Henter-Joyce, visit www. h j . com. 


25.12 Other Accessibility Tools 

Many additional accessibility products are available to assist people with disabilities. This 
section describes a variety of accessibility products, including hardware items and ad- 
vanced technologies. 

A braille keyboard , in addition to having each key labeled with the letter it represents, 
has the equivalent braille Symbol printed on the key. Braille keyboards are combined most 
often with a speech synthesizer or a braille display, so users can interact with the computer 
to verify that their typing is correct. 

Speech synthesis is another research-intensive area that benefits people with disabili¬ 
ties. Speech synthesizers aid those who are unable to communicate verbally. However, the 
growing popularity of the Web has prompted a great deal of work in the field of speech syn¬ 
thesis and speech recognition. These technologies are allowing individuals with disabilities 
to use computers more than ever before. The development of speech synthesizers is also 
enabling the improvement of other technologies, such as VoiceXML and AuralCSS 
(www.w3 .org/TR/REC-CSS2/aural.html). These tools allow people with visual 
impairment and the illiterate to access Web sites. 
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Despite the existence of adaptive Software and hardware for people with visual impair- 
ments, the accessibility of computers and the Internet is stili hampered by the high costs, 
rapid obsolescence and unnecessary complexity of current technology. Moreover, almost 
ali Software currently available requires installation by a person who can see. Ocularis is a 
project launched in the open-source community to help address these problems. Open 
source Software for people with visual impairments already exists, and although it is often 
superior to its proprietary, closed-source counterparts, it has not yet reached its full poten- 
tial. Ocularis ensures that the blind can use the Linux operating system fully, by providing 
an Audio User Interface (AUI). Products that integrate with Ocularis include a word pro- 
cessor, calculator, basic finance application, Internet browser and e-mail client. A screen 
reader will also be included with programs that have a command-line interface. The official 
Ocularis Web site is located at ocularis. sourceforge.net. 

People with visual impairments are not the only beneficiaries of the effort being made 
to improve markup languages. People with hearing impairments also have a number of 
tools to help them interpret auditory information delivered over the Web, such as Synchro- 
nized Multimedia Integration Language (SMIL™), discussed in Chapter 33, Multimedia. 
This markup language adds extra tracks —layers of content found within a single audio or 
video file—to multimedia content. The additional tracks can contain closed captioning. 

Technologies also are being designed to help people with severe disabilities, such as 
quadriplegia, a form of paralysis that affects the body from the neck down. One such tech¬ 
nology, EagleEyes, developed by researchers at Boston College (www.bc.edu/ 
eagleeyes), is a system that translates eye movements into mouse movements. Users 
move the mouse cursors by moving their eyes or heads and thereby can control computers. 

The company CitXCorp is developing new technology that translates Web information 
through the telephone. Information on a specific topic can be accessed by dialing the des- 
ignated number. The new Software is expected to be made available to users for $10 per 
month. For more information on regulations governing the design of Web sites to accom¬ 
modate people with disabilities, visit www.access-board.gov. 

In alliance with Microsoft, GW Micro, Henter-Joyce and Adobe Systems, Inc. are also 
working on Software to aid people with disabilities. JetForm Corp also is accommodating 
the needs of people with disabilities by developing server-based XML Software. The new 
Software allows users to download a format that best meets their needs. 

There are many Services on the Web that assist e-business owners in designing their 
Web sites to be accessible to individuals with disabilities. For additional information, the 
U.S. Department of Justice (www.usdoj .gov) provides extensive resources detailing 
legal issues and current technologies related to people with disabilities. 

These examples are just a few of the accessibility projects and technologies that cur¬ 
rently exist. For more information on Web and general computer accessibility, see the 
resources provided in Section 25.14, Internet and World Wide Web Resources. 


25.13 Accessibility in Microsoft® Windows® 2000 

Beginning with Microsoft Windows 95, Microsoft has included accessibility features in its 
operating systems and many of its applications, including Office 97, Office 2000 and Net- 
meeting. In Microsoft Windows 2000, the accessibility features have been significantly en- 
hanced. All the accessibility options provided by Windows 2000 are available through the 
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Accessibility Wizard, which guides users through ali the Windows 2000 accessibility 
features and configures their computers according to the chosen specifications. This section 
guides users through the configuration of their Windows 2000 accessibility options using 

the Accessibility Wizard. 

To access the Accessibility Wizard, users must have Microsoft Windows 2000. 
Select the Start button and select Programs followed by Accessories, Accessibility 
and Accessibility Wizard. When the wizard starts, the Welcome screen is displayed. 
Select Next to display a dialog (Fig. 25.11) that asks the user to select a font size. Click 

Next. 

Figure 25.12 shows the next dialog displayed. This dialog allows the user to activate 
the font size settings chosen in the previous window, change the screen resolution, enable 
the Microsoft Magnifier (a program that displays an enlarged section of the screen in a sep¬ 
arate window) and disable personalized menus (a feature which hides rarely used programs 
from the start menu, which can be a hindrance to users with disabilities). Make selections 
and select Next. 



Fig. 25.11 Text Size dialog. 
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Fig. 25.12 Display Settings dialog. 

The next dialog (Fig. 25.13) inquires about the user’s disabilities, which allows the 
Accessibility Wizard to customize Windows to better suit their needs. We selected 
everything for demonstration purposes. Select Next to continue. 

25.13.1 Tools for People with Visual Impairments 

When we checked ali the options in Fig. 25.13, the wizard configured Windows for people 
with visual impairments. As shown in Fig. 25.14, the dialog box allows users to resize the 
scroll bars and window borders to increase their visibility. Select Next to proceed to the 
next dialog. 


Accessibility Wizard 


Set Wizard Options 

You can configure Windows for your vision, hearing, and mobility needs. 


Select the statements that apply to you: 

W I am blind or have difficulty seeing things on screen 
W I am deaf or have difficulty hearing sounds from the computer 
W I have difficulty using the keyboard or mouse 
W I want to set administrative options: 

Restore Default Settings | 



Fig. 25.13 Accessibility Wizard initialization options. 
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— 


Scroll Bar and Window Border Size 

You can select the size of scroll bars and window borders. 



Select the scroll bar and window border size you want: 


d 

±\ 




A 

A 

▼ 

► 



< Back | Next > | Cancel | 


Fig. 25.14 Scroll Bar and Window Border Size diaiog. 

The diaiog in Fig. 25.15 allows users to resize icons. Users with poor vision, as well 
as users who have trouble reading, benefit from large icons. 

Selecting Next displays the Display Color Settings diaiog (Fig. 25.16). These set- 
tings allow users to change Windows’ color schemes and resize various screen elements. 
Select Next to view the diaiog (Fig. 25.17) for customizing the mouse cursor. 



Fig. 25.15 Setting up window element sizes. 
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Fig. 25.16 Display Color Settings options. 


Accessibility Wizard 


Mouse Cursor 

You can choose the size and color of your mouse cursor. 


Select the mouse cursor that is the size and color you want: 

White Black Inverting 


Regular 


* I 


Large 

1*1 

M 


Extra Large 


kl 




Current Cursor | 


Fig. 25.17 Accessibility Wizard mouse cursor adjustmenttool, 

Anyone who has ever used a laptop computer knows how difficult it is to see the mouse 
cursor. This is also a problem for people with visual impairments. To help solve this 
problem, the wizard offers larger cursors, black cursors and cursors that invert the colors of 
objects underneath them. Select Next. 
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25.13.2 Tools for People with Hearing Impairments 

This section, which focuses on accessibility for people with hearing impairments, begins 
with the SoundSentry window (Fig. 25.18). SoundSentry creates visual signals when 
system events occur. For example, people with hearing impairments are unable to hear the 
beeps that normally warn users, so SoundSentry flashes the screen when a beep occurs. 
To continue to the next dialog, select Next. 

The next window is the ShowSounds window (Fig. 25.19). ShowSounds adds 
captions to spoken text and other sounds produced by today’s multimedia-rich Software. 
For ShowSounds to work, Software developers must provide the captions and spoken 
text specifically within their Software. Make selections and select Next. 

25.13.3 Tools for Users Who Have Difficulty Using the Keyboard 

The next dialog is StickyKeys (Fig. 25.20). StickyKeys helps users who have difficulty 
pressing multiple keys at the same time. Many important computer commands are invoked 
by pressing specific key combinations. For example, the reboot command requires pressing 
Ctrl+Alt+Delete simultaneously. StickyKeys allows users to press key combinations in 
sequence rather than simultaneously. Select Next to continue to the BounceKeys dialog 
(Fig. 25.21). 

Another common problem for certain users with disabilities is accidently pressing the 
same key more than once. This problem typically results from pressing a key for a long 
period of time. BounceKeys force the computer to ignore repeated keystrokes. Select 

Next. 



Fig. 25.18 SoundSentry dialog. 
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Fig. 25.19 ShowSounds dialog. 

ToggleKeys (Fig. 25.22) alerts users that they have pressed one of the lockkeys (i.e., 
Caps Lock, Num Lock and Scroll Lock) by sounding an audible beep. Make selections and 
select Next. 

The Extra Keyboard Help dialog (Fig. 25.23) activates a tool that displays Informa¬ 
tion such as keyboard shortcuts and tool tips when they are available. Like ShowSounds. 
this tool requires that Software developers provide the content to be displayed. Selecting 
Next loads the MouseKeys (Fig. 25.24) customization window. 


© Copyright 1992-2002 by Deitel & Associates, Inc. AII Rights Reserved. 8/29/01 




































pythonhtpl_25.fm Page 1141 Wednesday, August 29, 2001 3:08 PM 


Chapter 25 


Accessibility 



Fig. 25.20 StickyKeys window. 


Accessibility Wizard 


BounceKeys 

You can set Windows to ignore repeated keystrokes. 



It you have motion disabilities, You might accidentally press a key too many times. 
Do you want Windows to ignore repeated keystrokes? 

C Yes 
(• No 


< Back 


Next > 


Cancel 


1141 


Fig. 25.21 BounceKeys dialog. 
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Fig. 25.22 ToggleKeys window. 


Accessibility Wizard 


Extra Keyboard Help 

Some programs offer T oolTip and other instructions that help you use the keyboard 
to complete tasks. 



If you do not use a mouse, you may want extra keyboard help. 

Do you want extra keyboard help to be displayed whenever it is available? 
C Yes 
(• No 


< Back 


Next > 


Cancel 


Fig. 25.23 Extra Keyboard Help dialog. 
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Fig. 25.24 MouseKeys window. 

MouseKeys uses the keyboard to emulate mouse movements. The arrow keys direct 
the mouse, while the 5key sends a single click. To double click, the user must press the + 
key; to simulate holding down the mouse button, the user must press the Ins (Insert) key 
and to release the mouse button, the user must press the Del ( Delete ) key. To continue to 
the next screen in the Accessibility Wizard. select Next. 

Today’s computer tools are made almost exclusively for right-handed users, including 
most computer mice. Microsoft recognized this problem and added the Mouse Button 
Settings window (Fig. 25.25) to the Accessibility Wizard. This tool allows users to 
create Virtual left-handed mice by swapping the button functions. Select Next. 


[Accessibility Wizard 


Mouse Button Settings 

You can change how the mouse buttons function. 



You may want to configure your mouse to work with the hand you prefer. 
How do you prefer to use your mouse? 

<• [Right-han ded Left button: 

C Left-handed • Normal select 

- Normal drag 

Right button: 

- Context menu 

- Special drag 



< Back | Next > | Cancel | 


Fig. 25.25 Mouse Button Settings window. 
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Mouse speed is adjusted by using the MouseSpeed (Fig. 25.26) dialog of the 
Accessibility Wizard. Dragging the scroll bar changes the speed. Selecting the Next 
button sets the speed and displays the wizard’s Set Automatic Timeouts window 
(Fig. 25.27). 

Although accessibility tools are important to users with disabilities, they can be a hin- 
drance to users who do not need them. In situations where varying accessibility needs exist, 
it is important that users be able to turn the accessibility tools on and off as necessary. The 
Set Automatic Timeouts window specifies a timeout period for the tools. A timeout 
either enables or disables a certain action after the computer has idled for a specified 
amount of time. A screen saver is a common example of a program with a timeout period. 
Here, a timeout is set to toggle the accessibility tools. 


[Accessibility Wizaid 


Mouse Speed 

You can change the speed of your mouse pointer. 



If you have difficulty positioning the mouse pointer to select items on the screen, you 
can adjust the speed of the pointer. 


Mouse pointer speed: Slow 


) 


Fast 


< Back j Next > | Cancel | 


Fig. 25.26 Mouse Speed dialog. 



Fig. 25.27 Set Automatic Timeouts dialog. 
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After selecting Next, the Save Settings to File dialog appears (Fig. 25.28). This 
dialog determines whether the accessibility settings should be used as the default settings, 
which are loaded when the computer is rebooted, or after a timeout. Set the accessibility 
settings as the default if the majority of users need them. Users can save the accessibility 
settings as well, by creating an. acw file, which, when clicked, activates the saved acces¬ 
sibility settings on any Windows 2000 computer. 

25.13.4 Microsoft Narrator 

Microsoft Narrator is a text-to-speech program for people with visual impairments. It 
reads text, describes the current desktop environment and alerts users when certain Win¬ 
dows events occur. Narrator aids in configuring Microsoft Windows. It is a screen reader 
that works with Internet Explorer, Wordpad, Notepad and most programs in the Control 
Panel. Although it is limited outside these applications. Narrator is excellent at navigat- 
ing the Windows environment. 

To get an idea of what Narrator does, we explain how to use it with various Windows 
applications. Select the Start button and select Programs, followed by Accessories, 
Accessibility and Narrator. Once Narrator is open, it describes the current foreground 
window. It then reads the text inside the window aloud to the user. Selecting OK displays 
the dialog in Fig. 25.29. 

Checking the first option instructs Narrator to describe menus and new Windows 
when they are opened. The second option instructs Narrator to speak the characters 
entered by the user. The third option moves the mouse cursor to the region being read by 
Narrator. Clicking the Voice button enables the user to change the pitch, volume and 
speed of the narrator voice. 



Fig. 25.28 Saving new accessibility settings. 
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Fig. 25.29 Narrator window. 

With Narrator running, open Notepad and select the File menu. Narrator 
announces the opening of the program and begins to describe the items in the File menu. 
When scrolling down the list. Narrator reads the current item to which the mouse is 
pointing. Type some text and press Ctrl-Shift-Enter to hear Narrator read it (Fig. 25.30). 
If the Read typed characters option is checked, Narrator reads each character as it is 
typed. The direction arrows on the keyboard can be used to make Narrator read. The up 
and down arrows cause Narrator to speak the lines adjacent to the current mouse position, 
and the left and right arrows cause Narrator to speak the characters adjacent to the current 
mouse position. 

25.13.5 Microsoft On-Screen Keyboard 

Some computer users lack the ability to use a keyboard but can use a pointing device such 
as a mouse. For these users, the On-Screen Keyboard is helpful. To access the On-Screen 
Keyboard, select the Start button and select Programs followed by Accessories. Ac¬ 
cessibility and On-Screen Keyboard. Figure 25.31 shows the layout of the Microsoft 
On-Screen Keyboard. 


"Helio, I am the Narrator utlllty. Thls 
is a test. Notice how Narrator follows 
punctuation and does not pause on carriage 
returns.” 


S[i Untitled - Notepad 


File Edit Format Help 


Helio, I am the Narrator utility. 

This is a test. 

Notice how Narrator follows 
punctuation and does not pause on 
carriage returns. 



Fig. 25.30 Narrator reading Notepad text. 
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Fig. 25.31 Microsoft On-Screen Keyboard 

Users who have difficulty using the On-Screen Keyboard should purchase more 

TM 

sophisticated products, such as Clicker 4 by Inclusive Technology. Clicker 4 aids people 
who cannot use a keyboard effectively. Its main feature is its ability to be customized. Keys 
can have letters, numbers, entire words or even pictures on them. For more information 
regarding Clicker 4, visit www. inclusive. co.uk/catalog/clicker.htm, 

25.13.6 Accessibility Features in Microsoft Internet Explorer 5.5 

Internet Explorer 5.5 offers a variety of options to improve usability. To access IE5.5’s ac¬ 
cessibility features, launch the program, select the Tools menu and select Internet Op¬ 
tions.... From the Internet Options menu, press the button labeled Accessibility... to 

open the accessibility options (Fig. 25.32). 


Internet Options 




General | Security | Content | Connections | Programs | Advanced | 


Home page 


You can change which page to use for your home page. 
Address: | http://www.msn.com/ 

Use Current | Use Default | Use Blank | 


Temporary Internet files 

Pages you view on the Internet are stored in a special folder 




for quick viewing later. 


Settings.. 


History 


nj The History folder contains links to pages youVe visited, for 
^'4 quickAccess to recently viewed pages. 

Days to keep pages in history: |2°H Ciear History | 


Accessibility 


Formatting 

r Ignore colors specified on Web pages 
r Ignore font styles specified on Web pages 
V Ignore font sizes specified on Web pages 


Languages.. 


esj^ility.. .~| 


User style sheet 

r Format documents using my style sheet; 

Style sheet: 

I 


-U*l 


Browse.. 


Apply 


Cancel 


Fig. 25.32 Microsoft Internet Explorer 5.5's accessibility options. 
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The accessibility options in IE5.5 augment users’ Web browsing. Users can ignore 
Web colors, Web fonts and font size tags. This eliminates problems that arise from poor 
Web page design and allows users to customize their Web browsers. Users can even specify 
a style sheet, which formats every Web site visited according to users’ personal prefer- 
ences. 

These are not the only accessibility options offered in IE5.5. In the Internet Options 
dialog click the Advanced tab. This opens the dialog shown in Fig. 25.33. The first option 
that can be set is labeled Always expand ALT text for images. By default, IE5.5 hides 
some of the <alt> text if it exceeds the size of the image it describes. This option forces 
ali the text to be shown. The second option reads: Move System caret with focus/ 
selection Changes. This option is intended to make screen reading more effective. Some 
screen readers use the system caret (the blinking vertical bar associated with editing text) 
to decide what is read. If this option is not activated, screen readers may not read Web pages 
correctly. 

Web designers often forget to take accessibility into account when creating Web sites 
and they use fonts that are too small. Many user agents have addressed this problem by 
allowing the user to adjust the text size. Select the View menu and then Text Size to 
change the font size using IE5.5. By default, the text size is set to Medium. 


25.14 Internet and World Wide Web Resources 

There are many accessibility resources on the Internet and World Wide Web, and this sec- 
tion lists a variety of these resources. 



Fig. 25.33 Advanced accessibility settings in Microsoft Internet Explorer 5.5. 
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www.synapseadaptive.com/joel/nat link.htm 

Python module natlink allows the user to access and control Dragon NaturallySpeaking, Software 
that provides a speech recognition system for Windows 95/98/NT. 

www.w3.org/WAI 

The World Wide Web ConsortiunTs Web Accessibility Initiative (WAI) site promotes the design of 
universally accessible Web sites. This site contains the current guidelines and forthcoming standards 
for Web accessibility. 

deafness.about.com/health/deafness/msubmenu6 .htm 

This is the home page of deaf ness. about. com. It is a resource to find information pertaining to 
deafness. 

www.cast.org 

CAST (Center for Applied Special Technology) offers Software, including a valuable accessibility 
checker, that help individuals with disabilities use a computer. The accessibility checker is a Web- 
based program that validates the accessibility of Web sites. 

www.trainingpost.org/3-2-inst.htm 

This site presents a tutorial on the Gunning Fog Index. The Gunning Fog Index grades text based on 
its readability. 

www.w3.org/TR/REC-CSS2/aural.html 

This page discusses Aural Style Sheets, outlining the purpose and uses of this new technology. 

laurence.canlearn.ca/English/learn/newaccessguide/indie 

INDIE stands for “Integrated NetWork of Disability Information and Education.” This site is home to 
a search engine that helps users fmd information on disabilities. 

java.sun.com/products/java-media/speech/forDevelopers/JSML 

This site outlines the specifications for JSML, Sun Microsystems Java Speech Markup Language. 
This language, like VoiceXML, could drastically improve accessibility for people with visual impair- 
ments. 

www.slcc.edu/webguide/lynxit.html 

Lynxit is a development tool that allows users to view any Web site as a text-only browser would. The 
site’s forni allows you to enter a URL and returns the Web site in text-only format. 

www.trill-home.com/lynx/pubi ic_lynx.html 

This site allows users to browse the Web with a Lynx browser. Users can view how Web pages appear 
to users without the most current technologies. 

www.wgbh.org/wgbh/page s/ncam/accesslinks.html 

This site provides links to other accessibility pages across the Web. 

ocfo. ed.gov/coninfo/clibrary/software .htm 

This page is the U.S. Department of Education’s Web site for Software accessibility requirements. It 
helps developers produce accessible products. 

www-3. ibm.com/able/access.html 

The homepage of IBM's accessibility site provides information on IBM products and their accessi¬ 
bility and discusses hardware, Software and Web accessibility. 

www.w3.org/TR/voice-tts-reqs 

This page explains the speech synthesis markup requirements for voice markup languages. 

www.voicexmlcentral.com 

This site contains information about VoiceXML, such as the specification and the document type def- 
inition (DTD). 
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deafness.about.com/health/deafness/msubvib.htm 

This site provides information on vibrotactile devices, which allow individuals with hearing impair- 
ments to experience audio in the form of vibrations. 

web .ukonline.co.uk/ ddmc/software.html 

This site provides links to Software for people with disabilities. 

www.hj.com 

Henter-Joyce is a division of Freedom Scientific that provides Software for people with visual impair- 
ments. It is the home of JAWS. 

www.abledata.com/text2/icg_hear.htm 

This page contains a consumer guide that discusses technologies for people with hearing impair- 
ments. 

www.washington.edu/doit 

The University of Washington"s DO-IT (Disabilities, Opportunities, Intemetworking and Technolo¬ 
gy) site provides information and Web development resources for creating universally accessible Web 
sites. 

www.webable.com 

WebABLE contains links to many disability-related Internet resources and is geared towards those de- 
veloping technologies for people with disabilities. 

www.webaim.org 

The WebAIM site provides a number of tutorials, articles, simulations and other useful resources that 
demonstrate how to design accessible Web sites. The site provides a screen reader simulation. 

www.speech.cs.cmu.edu/comp.speech/SpeechLinks.html 

The Speech Technology Hyperlinks page has over 500 links to sites related to computer-based speech 
and speech recognition tools. 

www.islandnet.com/~tslemko 

The Micro Consulting Limited site contains Shareware speech synthesis Software. 

www.chantinc.com/technology 

This page is the Cluint Web site, which discusses speech technology and how it works. Chant also 
provides speech synthesis and speech recognition Software. 

whatis.techtarget.com/definition 

This site provides definitions and information about several topics, including CallXML. Its thorough 
definition of CallXML differentiates CallXML and VoiceXML, another technology developed by 
Voxeo. The site contains links to other published articles discussing CallXML. 

www.oasis-open.org/cover/callxmlv2.html 

This site provides a comprehensive list of the CallXML tags complete with descriptions of each tag. 
Short examples on how to apply the tags in various applications are provided. 

SUMMARY 

• Enabling a Web site to meet the needs of individuals with disabilities is an issue relevant to all 
business owners. 

• Legal ramifications exist for Web sites that discriminate against people with disabilities (i.e., by 
not providing them with adequate access to the site’s resources). 

• Technologies such as voice activation, visual enhancers and auditory aids enable individuals with 
disabilities to work in more positions. 
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• On April 7, 1997, the World Wide Web Consortium (W3C) launched the Web Accessibility Ini- 
tiative (WAI). The WAI is an attempt to make the Web more accessible; its mission is described 

atwww.w3 .org/WAI. 

• Accessibility refers to the level of usability of an application or Web site for people with disabili- 
ties. Total accessibility is difficult to achieve because there are many different disabilities, lan- 
guage barriers, and hardware and Software inconsistencies. 

• The majority of Web sites are considered either partially or totally inaccessible to people with vi- 
sual, learning or mobility impairments. 

• The WAI publishes the Web Content Accessibility Guidelines 1.0, which assigns priorities to a 
three-tier structure of checkpoints. The WAI currently is working on a draft of the Web Content 
Accessibility Guidelines 2.0. 

• One important WAI requirement is to ensure that every image, movie and sound on a Web site is 
accompanied by a description that clearly defines the objecfs purpose; this is called an <alt> 
tag. 

• Specialized user agents, such as screen readers (programs that allow users to hear what is being 
displayed on their screen) and braille displays (devices that receive data from screen-reading Soft¬ 
ware and output the data as braille), allow people with visual impairments to access text-based in- 
formation that is normally displayed on the screen. 

• Using a screen reader to navigate a Web site can be time consuming and frustrating, because 
screen readers are unable to interpret pictures and other graphical content that do not have altema- 
tive text. 

• Including links at the top of each Web page provides easy access to page’s main content. 

• Web pages with large amounts of multimedia content are difficult for user agents to interpret un- 
less they are designed properly. Images, movies and most non-XHTML objects cannot be read by 
screen readers. 

• Web designers should avoid misuse of the ait attribute; it is intended to provide a short descrip¬ 
tion of an XHTML object that may not load properly on all user agents. 

• The value of the longdesc attribute is a text-based URL, linked to a Web page, that describes 
the image associated with the attribute. 

• When creating a Web page intended for the general public, it is important to consider the reading 
level at which it is written. Web site designers can make their sites more readable through the use 
of shorter words, as sonte users may have difficulty reading long words. In addition, users from 
other countries may have difficulty understanding slang and other nontraditional language. 

• Web designers often use frames to display more than one XHTML file at a time and are a conve¬ 
nient way to ensure that certain content is always on screen. Unfortunately, frames often lack prop- 
er descriptions, which prevents users with text-based browsers, or users who lack sight, from 
navigating the Web site. 

• The <nof rames> tag allows the designer to offer altemative content to users whose browsers do 
not support frames. 

• VoiceXML has tremendous implications for people with visual impairments and for the illiterate. 
VoiceXML, a speech recognition and synthesis technology, reads Web pages to users and under- 
stands words spoken into a microphone. 

• A VoiceXML document is made up of a series of dialogs and subdialogs, which resuit in spoken 
interaction between the user and the computer. VoiceXML is a voice-recognition technology. 

• CallXML, a language created and supported by Voxeo, creates phone-to-Web applications. 
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• When a user accesses a CallXML application, the incoming telephone call is referred to as a ses- 
sion. A CallXML application can support multiple sessions that enable the application to receive 
multiple telephone calls at any given time. 

• A session terminates either when the user hangs up the telephone or when the CallXML applica¬ 
tion invokes the hangup clement. 

• The contents of a CallXML application are inserted within the <callxml> tag. 

• CallXML tags that perform similar tasks should be enclosed within the <block> and < /block> 
tags. 

• To deploy a CallXML application, register with the Voxeo Community, which assigns a telephone 
number to the application so that other users may access it. 

• Voxeo’s logging feature enables developers to debug their telephone application by observing the 
“conversation” between the user and the application. 

• Braille keyboards are similar to Standard keyboards, except that in addition to having each key la- 
beled with the letter it represents, braille keyboards have the equivalent braille Symbol printed on 
the key. Most often, braille keyboards are combined with a speech synthesizer or a braille display, 
so users can interact with the computer to verify that their typing is correct. 

• People with visual impairments are not the only beneficiaries of the effort to improve markup lan- 
guages. Individuals with hearing impairments also have a great number of tools to help thern in- 
terpret auditory information delivered over the Web. 

• Speech synthesis is another research area that helps people with disabilities. 

• Open-source Software for people with visual impairments already exists and is often superior to 
most of its proprietary, closed-source counterparts. 

• People with hearing impairments benefit from Synchronized Multimedia Integration Language 
(SMIL). This markup language adds extra tracks—layers of content found within a single audio 
or video file. The additional tracks can contain data such as closed captioning. 

• EagleEyes, developed by researchers at Boston College (www.bc.edu/eagleeyes), trans- 
lates eye movements into mouse movements. Users move the mouse cursor by moving their eyes 
or heads and are thereby are able to control computers. 

• All of the accessibility options provided by Windows 2000 are available through the Accessibil¬ 
ity Wizard. The Accessibility Wizard takes a user step by step through all of the Windows ac¬ 
cessibility features and configures his or her computer according to the chosen specifications. 

• Microsoft Magnifier enlarges the section of your screen surrounding the mouse cursor. 

• To solve problems seeing the mouse cursor, Microsoft offers the ability to use larger cursors, black 
cursors and cursors that invert objects undemeath them. 

• SoundSentry is a tool that creates visual signals when system events occur. 

• ShowSounds adds captions to spoken text and other sounds produced by today’s multimedia- 
rich Software. 

• StickyKeys is a program that helps users who have difficulty pressing multiple keys at the same 
time. 

• BounceKeys forces the computer to ignore repeated keystrokes, solving the problem of acci- 
dentally pressing the same key more than once. 

• ToggleKeys causes an audible beep to alert users that they have pressed one of the lockkeys (i.e., 
Caps Lock, Num Lock, or Scroll Lock). 

• MouseKeys is a tool that uses the keyboard to emulate mouse movements. 
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• The Mouse Button Settings tool allows you to create a Virtual left-handed mouse by swapping 
the button functions. 

• A timeout either enables or disables a certain action after the computer has idled for a specified 
amount of time. A common example of a timeout is a screen saver. 

• You can create an . acw file, that, when clicked, will automatically activate the saved accessibility 
settings on any Windows 2000 computer. 

• Microsoft Narrator is a text-to-speech program for people with visual impairments. It reads text, 
describes the current desktop environment and alerts the user when certain Windows events occur. 
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TERMINOLOGY 

accessibility 

Accessibility Wizard 
Accessibility Wizard: Display 
Color Settings 

Accessibility Wizard: Icon Size 
Accessibility Wizard: Mouse Cursor 
Accessibility Wizard: Scroll Bar 
and Window Border Size 

action element 
ait attribute 

Americans with Disabilities Act (ADA) 
<assign> tag in VoiceXML 
AuralCS S 

<block> tag in VoiceXML 

BounceKeys 

braille display 
braille keyboard 
<break> tag in VoiceXML 
<b> tag (bold) 

CallXML 

<callxml> tag in CallXML 

caption 

Cascading Style Sheets (CSS) 
count attribute in VoiceXML 
<choice> tag in VoiceXML 
CSS2 
D-link 

default setting 
EagleEyes 

encoding 

< enumerat e > tag in VoiceXML 
event handler 

<exit> tag in VoiceXML 
f ield variable 
<f illed> tag in VoiceXML 
<form> tag in VoiceXML 
frames 

get request type 

<getDigits> tag in CallXML 

global variable 

<goto> tag in VoiceXML 

<grammar> tag in VoiceXML 

Gunning Fog Index 

header cells 

headers attribute 

<hl> tag 

<strong> tag 

style sheet 

system carat 

<subdialog> tag in VoiceXML 
summary attribute 
Synchronized Multimedia Integration 
Language (SMIL) 
tables 
<td> tag 

termDigits attribute in CallXML 
<text> tag in CallXML 
text-to-speech (TTS) 

<th> tag 
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IBM ViaVoice 
id attribute 
<img> tag 

JAWS (lob Access With Sound) 
level attribute in VoiceXML 
linearize 

<link> tag in VoiceXML 
local dialog 
logging feature 
logic element 
longdesc attribute 
Lynx 

markup language 

maxDigits attribute in CallXML 
maxTime attribute in CallXML 
<menu> tag in VoiceXML 

Microsoft Magnifier 

Microsoft Narrator 

Mouse Button Settings window 

MouseKeys 

Narrator 

<next> tag in VoiceXML 
nolimit (default value) 

<noframes> tag 

Ocularis 

<onHangup> tag in CallXML 

<onMaxSilence> tag in CallXML 

On-Screen Keyboard 

<onTermDigits> tag in CallXML 

post request type 

priority 1 checkpoint 

priority 2 checkpoint 

priority 3 checkpoint 

<prompt> tag in VoiceXML 

quick tip 

readability 

Read typed characters 

screen reader 

session 

sessionlD 

Set Automatic Timeout window 

ShowSounds 

SoundSentry 

speech recognition 
speech synthesizer 

StickyKeys 

track 
Unicode 
user agent 

<var> tag in VoiceXML 

var attribute in CallXML 

version 

ViaVoice 

voice server 

Voice Server SDK 

VoiceXML 

Voxeo Community 

<vxml> tag in VoiceXML 

Web Accessibility Initiative (WAI) 
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timeout 

<title> tag 

ToggleKeys 

SELF-REVIEW EXERCISES 

25.1 Expand the foliowing acronyms: 

a) W3C. 

b) WAI. 

c) JAWS. 

d) SMIL. 

e) CSS. 

25.2 Fili in the blanks in each of the following statements. 

a) The highest priority of the Web Accessibility Initiative ensures that each_, 

_and_is accompanied by a description that clearly defines its pur- 

pose. 

b) Technologies such as_,_and_enable individuals with 

disabilities to work in a large number of positions. 

c) Although they can be used as a great layout tool,_are difficult for screen read- 

ers to interpret and convey clearly to a user. 

d) To make a frame accessible to individuals with disabilities, it is important to include 
_tags on a Web page. 

e) _and_often assist blind people using computers. 

k) CallXML creates_applications that allow businesses to receive and send tele- 

phone calls. 

l) A_tag must be associated with the <getDigits> tag. 

25.3 State whether each of the following is true or false. If false, explain why. 

a) Screen readers have no problem reading and translating images. 

b) When writing pages for the general public, it is important to consider the reading diffi- 
culty level of the text. 

c) The <alt> tag helps screen readers describe images in a Web page. 

d) Left-handed people have been helped by the improvements made in speech-recognition 
technology more than any other group of people. 

e) VoiceXML lets users interact with Web content using speech recognition and speech 
synthesis technologies. 

f) Elements such as oiiMaxSilence and onTermDigitare event handlers because they 
perform a specified task when invoked. 

g) The debugging feature of the Voxeo Account Manager assists developers in de- 
bugging their CallXML application. 

ANSWERS TO SELF-REVIEW EXERCISES 

25.1 a) World Wide Web Consortium, b) Web Accessibility Initiative. c) Job Access with Sound. d) 
Synchronized Multimedia Integration Language. e) Cascading Style Sheets. 

25.2 a) image, rnovie, sound. b) voice activation, visual enhancers and auditory aids. c) tables. d) 
<noframes>. e) Braille displays, braille keyboards. f) phone-to-Web. g) <onTermDigit>. 

25.3 a) False. Screen readers have no way of telling a user what is shown in an image. If the pro- 
grammer includes an ait attribute inside the <img> tag, the screen reader reads this description to 
the user. b) True. c) True. d) False. Although left-handed people can use speech-recognition technol- 
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Web Content Accessibility Guidelines 1.0 

XML declaration 

XML Guidelines (XML GL) 
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ogy as everyone else can, speech-recognition technology has had the largest impact on the blind and 
on people who have trouble typing. e) True. f) True. g) False. The logging feature assists developers 
in debugging their CallXML application. 

EXERCISES 

25.4 Insert XHTML markup into each segment to make the segment accessible to someone with 
disabilities. The contents of images and frames should be apparent from the context and filenames. 

a) <img src = width = height = /> 

b) <table width = > 

<trxth Language /th><th>Version</thx/tr> 

<trxtd XHTML /tdxtd>l . 0</tdx/tr> 
<trxtd>Perl</tdxtd>5 .6. 0</tdx/tr> 
<trxtd>Java</tdxtd>l. 3</tdx/tr> 

</table> 

25.5 Define the following ternis: 

a) Aetion element. 

b) Gunning Fog Index. 

c) Screen reader. 

c) Session. 

d) Web Accessibility Initiative (WAI). 

25.6 Describe the three-tier structure of checkpoints (priority-one, priority-two and priority-three) 
set forth by the WAI. 

25.7 Why do misused <hl> heading tags create problems for screen readers? 

25.8 Use CallXML to create a voice mail system that plays a voice mail greeting and records the 
message. Have friends and classmates call your application and leave a message. 

(*** EXERCISE SOLUTIONS***) 

EXERCISES 

25.4 Insert XHTML markup into each segment to make the segment accessible to someone with 
disabilities. The contents of images and frames should be apparent from the context and filenames. 

a) <img src = width = height = /> 

b) <table width = > 

<trxth Language < /thxth>Version</thx/tr> 

<trxtd XHTML /tdxtd>1.0</tdx/tr> 
<trxtd>Perl</tdxtd>5 .6. 0</tdx/tr> 
<trxtd>Java</tdxtd>l . 3</tdx/tr> 

</table> 

c) <map name = > 

<area href = "index.html" shape = "rect" 
coords = "50, 120, 80, 150" /> 

<area href = "catalog.html" shape = "circle" 

coords = "220, 30" /> 

</map> 

<img src = "antlinks.gif" width = "300" height = "200" 

usemap = "#links" /> 


© Copyright 1992-2002 by Deitel & Associates, Inc. AII Rights Reserved. 8/29/01 



























pythonhtpl_25.fm Page 1157 Wednesday, August 29, 2001 3:08 PM 


Chapter 25 


Accessibility 1157 


ANS: a) <img src = 

ait = "Image of 

b) <table width = 

<trxth id = "Lc 
<trxtd headers 
<trxtd headers 
<trxtd headers 

</table> 

c) <map nane = 

<area href = "ii 
coords = "50, 
<area href = "c< 
coords = "22( 

</map> 

<img src = "antlinJ 

usemap = "#1infer 


. jpg’ width 
Dogs" /> 

summary = " T1 


height = 


>Language</thxth id = 
>Version</thx/tr> 

>XHTML</tdxtd headers = 
>1. 0</tdx/tr> 

Perl</tdxtd headers = 
>5.6. 0</tdx/tr> 

>Java</tdxtd headers = 
>1.3</tdx/tr> 


ax.html" shape = "rect" 

L20, 80, 150" ait = "Index' 
alog.html" shape = "circle' 
30" ait = "Catalog" /> 

.gif" width = "300" height 

ait = "Links" /> 


/> 


25.5 Define the following ternis: 

a) Aetion element. 

b) Gunning Fog Index. 

c) Screen reader. 

d) Session. 

e) Web Accessibility Initiative (WAI). 

ANS: a) Aetion elements perform specified tasks, such as answering an incoming telephone call 
or hanging up on a telephone call, during the current session. b) The Gunning Fog Index is a formula 
that produces a readability grade when applied to a text sample. It allows Web developers to evaluate 
the readability grade of their Web sites, so that the Web sites are accessible to the majority of users. 
c) A screen reader is a program that allows users to hear what is being displayed on their screen. d) 
A session is any given telephone call to which the CallXML application responds. A CallXML appli- 
cation can support multiple sessions at once, and each session is assigned a unique sessionID. e) The 
Web Accessibility Initiative (WAI) is an attempt to make the Web more accessible. The WAI pub- 
lished the Web Content Accessibility Guidelines (WCAG) 1.0 to set forth checkpoints that helped 
businesses determine if their Web sites are accessible to everyone. 

25.6 Describe the three-tier structure of checkpoints (priority one, priority two and priority three) 
set forth by the WAI. 

ANS: Priority-one checkpoints are goals that must be met in order to ensure accessibility. Pri- 
ority-two checkpoints, though not essential, are highly recommended. Priority-three checkpoints 
slightly improve accessibility. 

25.7 Why do <hl> heading tags that are inappropriately used create problems for screen readers? 
ANS: The <hl> heading tags are often erroneously used to make text large and bold. The 

desired visual effect may be achieved, but it creates a problem for screen readers. When a screen 
reader Software encounters <hl> tags, it may verbally inform the user that a new section has been 
reached, which may confuse the user. It is best to use <hl> tags in accordance with their XHTML 
specification (e.g., as headings to introduce important sections of a document). 
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25.8 Use CallXML to create a voice mail system that plays a voice mail greeting and records the 
message. Have friends and classmates call your application and leave a message. 

ANS: 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 


<?xml version = '1.0" encoding = TF-8"?> 

<!-- Exercise 5: isbn_voice.xml --> 

<!-- Records a voice mail message --> 

<callxml> 

<block> 

<text> 

Hi, you have reached Kate Steinbuhler. I cannot come to 
the phone right now, so please leave a message and I will 
return your call as soon as possible. To end the call, 
either press the pound sign, or simply hang up. Thank you. 

</text> 

<!-- Records a message spoken by the caller and sends --> 
<!-- the file to an email account. The user has 60 --> 

<!— seconds to leave a message. --> 

<recordAudio format = "audio/wav" 

value = "mailto:rashmi.jayaprakash@deitel.net" 
termDigits = #" 

maxDigits = "1" 
maxTime = "60s" /> 


<!— Requests that the user enter a message or end the --> 

<!— call after the elapsed time of 60 seconds. —> 

< onMaxSi1enc e > 

<text> 

Please leave a message or press the pound sign to exit. 

</text> 

crecordAudio format = "audio/wav" 

value = "mailto:rashmi.jayaprakash@deitel.net" 

termDigits = "#" 
maxDigits = "1" 
maxTime = "60s /> 

</onMaxSilence> 

<onTermDigit value = > 

<hangup/> 

</onTermDigit> 

</block> 

<!-- Event handler that terminates the call --> 

•conHangup /> 

</callxml> 


CallXML example that acts as a voice mail system (part 1 of 2). 
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3 Voxeo Account Manager - Microsoft Internet Explorer 




@-Logging 


Session ID Time (h:m:s) 


Logging started, waiting for call 


00000001998 07:56:05.150 PM 


00000001998 07:56:05.681 PM 


00000001998 07:56:22.087 PM 


00000001998 

00000001998 

00000001998 

00000001998 

00000001998 


07:56:33.228 PM 
07:56:33.228 PM 
07:56:33.228 PM 
07:56:33.228 PM 
07:56:33.228 PM 


Simline Error Event Aetion 



Aetion 


goto value= M http://buQ2buQ.com/isbn voice-xml " 

submit="callerID=6175557444 calledID=6785555414 session.accountid=2992 

session.calledid=6785555414 session.callerid=6175557444 

session. id=cf3c0aeeef7e0b4299d9fa55fee4f8e2-1998 

session.ttsdisplayname=English-Malel session.ttsengine=Fonix 

session.ttslanguage=English session.ttsvoice=Malel" method="get" cache="" 

text TTS="Hi, you have reached Kate Steinbuhler. I cannot come to the 

phone right now, so please leave a message and I will return your call as 

soon as possible. To end the call, either press the pound sign, or simply 

hang up. Thank you." format="connected" termDigits= IMI clearDigits=0 

recordAudio value="mailto: rashmi.jayaprakash@deitel.net" 

format="audio/wav" termDigits="#" cache="" clearDigits=0 beep=l 

maxTime=60000 maxSilence=5000 

recording time: 8.0 secs 

termdigit "#" 

hangup 

hangup 

end of session 


Opening page http://loggerl. voxeo. com/newlog.php?ledg=l&accountid=2992... 


40 Internet 


CallXML example that acts as a voice mail system (part 2 of 2). 
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[***Notes To Reviewers***] 

• Please list URLs that discuss Python-specific accessibility issues. We are conducting our own re- 
search and will post this chapter for second round reviews after the inclusion of Python-specific 
material. 

• Please mark your comments in place on a paper copy of the chapter. 

• Please return only marked pages to Deitel & Associates, Inc. 

• Please do not send us e-mails with detailed, line-by-line comments; mark these directly on the pa¬ 
per pages. 

• Please feel free to send any lengthy additional comments by e-mail to cheryl. yaeger@dei- 
tel.net. 

• Please run ali the code examples. 

• Please check that we are using the correct programming idioms. 

• Please check that there are no inconsistencies, errors or omissions in the chapter discussions. 

• The manuscript is being copyedited by a professional copy editor in parallel with your reviews. 
That person will probably find most typos, spelling errors, grammatical errors, etc. 

• Please do not rewrite the manuscript. We are concemed mostly with technical correctness and cor¬ 
rect use of idiom. We will not make significant adjustments to our writing style on a global scale. 
Please send us a short e-mail if you would like to make such a suggestion. 

• Please be constructive. This book will be published soon. We all want to publish the best possible 
book. 

• If you find something that is incorrect, please show us how to correct it. 

• Please read all the back matter including the exercises and any Solutions we provide. 

• Please review the index we provide with each chapter to be sure we have covered the topics you 
feel are important. 
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Introduction to XHTML: 

Part 1 


Objectives 

• To understand important components of XHTML 
documents. 

• To use XHTML to create World Wide Web pages. 

• To add images to Web pages. 

• To understand how to create and use hyperlinks to 
navigate Web pages. 

• To mark up lists of information. 

To read between the lines was easier than tofollow the text. 
Henry James 

High thoughts must have high language. 

Aristophanes 



Under 

Constructi on 
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Chapter 26 


Outline 

26.1 
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26.2 

Editing XHTML 

26.3 

First XHTML Example 

26.4 

W3C XHTML Validation Service 

26.5 

Headers 

26.6 

Linking 

26.7 

Images 

26.8 

Special Characters and More Line Breaks 

26.9 

Unordered Lists 

26.10 

Nested and Ordered Lists 

26.11 

Internet and World Wide Web Resources 

Summary • Terminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 


26.1 Introduction 

Welcome to the world of opportunity created by the World Wide Web. The Internet is now 
three decades old, but it was not until the World Wide Web became popular in the 1990s 
that the explosion of opportunity that we are stili experiencing began. Exciting new devel- 
opments occur almost daily—the pace of innovation is unprecedented by any other tech- 
nology. In this chapter, you will develop your own Web pages. As the book proceeds, you 
will create increasingly appealing and powerful Web pages. In the later portion of the book, 
you will learn how to create complete Web-based applications. 

In this chapter, we begin unlocking the power of Web-based application development 
with XHTML 1 —the Extensible Hypertext Markup Language. In later chapters, we intro- 
duce more sophisticated XHTML techniques, such as tables, which are particularly useful 
for structuring information from databases (i.e., Software that Stores structured sets of 
data), and Cascading Style Sheets (CSS), which make Web pages more visually appealing. 

Unlike procedural programming languages such as C, Fortran, Cobol and Pascal, 
XHTML is a markup language that specifies the format of text that is displayed in a Web 
browser such as Microsoft’s Internet Explorer or Netscape’s Communicator. 

One key issue when using XHTML 1 2 is the separation of the presentation of a docu- 
ment (i.e., the document’s appearance when rendered by a browser) from the structure of 
the documenfs information. Over the next several chapters, we discuss this issue in depth. 


1. XHTML has replaced the HyperText Markup Language (HTML) as the primary means of describ- 
ing Web content. XHTML provides more robust, richer and extensible features than HTML. For 
more on XHTML/HTML visit www.w3 .org/markup. 
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26.2 Editing XHTML 

In this chapter, we write XHTML in its source-code form. We create XHTML documents 
by typing them in with a text editor (e.g., Notepad, Wordpad, vi, emacs, etc.), saving the 
documents with either an .html or . htm file-name extension. 



Good Programming Practice 26.1 

Assign documents file names that describe their functionality. This practice can help you 
identify documents faster. It also helps people who want to link to apage, by giving them an 
easy-to-remember name. For example, ifyou are writing an XHTML document that contains 
product information, you might want to call it products. html. 


Machines running specialized Software called Web servers store XHTML documents. 
Clients (e.g., Web browsers) request specific resources from the Web server. For example, 
typing www.deitel.com/books/downloads.htm into a Web browser’s address 
field requests downloads.htm from the Web server running at www.deitel.com. 
This document resides in a directory named books. For now, we simply place the XHTML 
documents on our machine and open them using Internet Explorer. 


26.3 First XHTML Example 3 

In this chapter and the next, we present XHTML markup and provide screen captures that 
show how Internet Explorer 5.5 renders (i.e., displays) the XHTML. Every XHTML doc¬ 
ument we show has line numbers for the reader’ s convenience. These line numbers are not 
part of the XHTML documents. 

Our first example (Fig. 26.1) is an XHTML document named main.html that dis¬ 
plays the message “Welcome to XHTML!” in the browser. 

The key line in the program is line 14, which telis the browser to display “Welcome to 
XHTML!” Now let us consider each line of the program. 

Lines 1 is the optional XML declaration that identifies the version of XML used in 
the document. Line 2-3 is required for XHTML documents to conform with proper 
XHTML syntax. 

Lines 5-6 are XHTML comments. Comments do not cause the browser to perform any 
action when the user loads the XHTML document into the Web browser to view the docu¬ 
ment. XHTML comments always start with <!- - and end with Each of our XHTML 
examples include comments that specify the figure number and file name, and provide a 
brief description of the example’s purpose. Subsequent examples include comments in the 
markup, especially to highlight new features. 


2. As this book was being submitted to the publisher, XHTML 1.1 became a World Wide Web Con¬ 
sortium (W3C) Recommendation. The XHTML examples presented in this book are based upon 
the XHTML 1.0 Recommendation, because Internet Explorer 5.5 does not support the full set of 
XHTML 1.1 features. In the future, Internet Explorer and other browsers will support XHTML 
1.1. When this occurs, we will update our Web site (www.deitel. com) with XHTML 1.1 ex¬ 
amples and information. 

3. All of the examples presented in this book are available at www.deitel.com and on the CD- 
ROM that accompanies this book. 
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1 <?xml version = ?> 

2 <! DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Striet//EN 

3 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-strict.dtd"> 

4 

5 <!-- Fig. 26.1: main.html --> 

6 <!— Our first Web page --> 

7 

8 <html xmlns = "http://www.w3.org/1999/xhtml"> 

9 <head> 

<title>Python How to Program - Welcome</title> 

11 </head> 

12 

13 <body> 

14 <p>Welcome to XHTML! </p> 

15 </body> 

16 </html> 



Fig. 26.1 First XHTML example. 

XHTML markup contains text that represents the content of a document and elements 
that specify a document’s structure. Some important elements of an XHTML document 
include the html element, the head element and the body element. The html element 
encloses the head section (represented by the head element ) and the body section (repre- 
sented by the body element ). The head section contains information about the XHTML 
document, such as the title of the document. The head section also can contain special doc¬ 
ument formatting instructions called style sheets and client-side programs called scripts for 
creating dynamic Web pages. (We introduce style sheets in Chapter 28.) The body section 
contains the page’s content that the browser displays when the user visits the Web page. 

XHTML documents delimit an element with start and end tags. A start tag consists of 
the element name in angle brackets (e.g., <html>). An end tag consists of the element 
name preceded by a / in angle brackets (e.g., </html>). In this example lines 8 and 16 
define the start and end of the html element. Note that the end tag on line 16 has the same 
name as the start tag, but is preceded by a / inside the angle brackets. Many start tags define 
attributes that provide additional information about an element. Browsers can use this addi- 
tional information to determine how to process the element. Each attribute has a name and 
a valite separated by an equal sign (=). Line 8 specifies a required attribute (xmlns) and 
value (http://www.w3.org/1999/xhtml) for the html element in an XHTML 
document. Simply copy and paste the html element start tag on line 8 into your XHTML 
documents. 


4 - 
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Common Programming Error 26.1 




Not enclosing attribute values in either single or double quotes is a syntax error. 

Common Programming Error 26.2 


Using uppercase letters in an XHTML element or attribute name is a syntax error. 


An XHTML document divides the html element into two sections—head and body. 
Lines 9-11 define the Web page’s head section with a head element. Line 10 specifies a 
title element. This is called a nested element, because it is enclosed in the head ele¬ 
ment’s start and end tags. The head element also is a nested element, because it is enclosed 
in the html element’s start and end tags. The title element describes the Web page. 
Tities usually appear in the title bar at the top of the browser window and also as the text 
identifying a page when users add the page to their list of Favorites or Bookmarks, 
which enable users to return to their favorite sites. Search engines (i.e., sites that allow users 
to search the Web) also use the title for cataloging purposes. 



Good Programming Practice 26.2 

Indenting nested elements emphasizes a document’s structure andpromotes readability. 



Common Programming Error 26.3 

XHTML does notpermit tags to overlap—a nested element's end tag must appear in the doc¬ 
ument before the enclosing element’s end tag. For example, the nested XHTML tags 
<headxtitle>hello</headx/title> cause a syntax error, because the enclos¬ 
ing head element’s ending </head> tag appears before the nested title element’s end- 

ing </title> tag. 



Good Programming Practice 26.3 

Use a consistent title naming convention for all pages on a site. For example, ifa site is 
named “Bailey’s Web Site, ” then the title of the main page mightbe “Bailey’s Web Site — 
Links, ” etc. This practice can help users better understand the Web site 's structure. 


Line 13 opens the document’s body element. The body section of an XHTML docu¬ 
ment specifies the document’s content, which may include text and tags. 

Some tags, such as the paragraph tags ( <p> and </p>) in line 14, markup text for dis- 
play in a browser. All text placed between the <p> and </p> tags form one paragraph. 
When the browser renders a paragraph, a blank line usually precedes and follows paragraph 
text. 

This document ends with two closing tags (lines 15-16). These tags close the body 
and html elements, respectively. The ending </html> tag in an XHTML document 
informs the browser that the XHTML markup is complete. 

To view this example in Internet Explorer, perform the following steps: 

1. Copy the Chapter 26 examples onto your machine from the CD that accompanies 
this book (or download the examples from www. deitel. com). 

2. Launch Internet Explorer and select Open... from the File Menu. This displays 
the Open dialog. 
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3. Click the Open dialog’s Browse... button to display the Microsoft Internet 
Explorer file dialog. 

4. Navigate to the directory containing the Chapter 26 examples and select the file 

main.html, then click Open. 

5. Click OK to have Internet Explorer render the document. Other examples are 
opened in a similar manner. 

At this point your browser window should appear similar to the sample screen capture 
shown in Fig. 26.1. (Note that we resized the browser window to save space in the book.) 


26.4 W3C XHTML Validation Service 

Programming Web-based applications can be complex and XHTML documents must be 
written correctly to ensure that browsers process them properly. To promote correctly writ- 
ten documents, the World Wide Web Consortium (W3C) provides a validation Service 
(validator .w3 .org) for checking a document’s syntax. Documents can be validated 
from either a URL that specifies the location of the file or by uploading a file to the site 
validator .w3 . org/ file-upload.html. Uploading a file copies the file from the 
user’s computer to another computer on the Internet. Figure 26.2 shows main.html 
(Fig. 26.1) being uploaded for validation. Although the W3C’s Web page indicates that the 
Service name is HTML Validation Service , 4 the Service validatse the syntax of XHTML 
documents. Ali the XHTML examples in this book are validated successfully using val¬ 
idator . w3. org. 


4. HTML (HyperText Markup Language) is the predecessor of XHTML designed for marking up 
Web content. HTML is a deprecated technology. 
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Fig. 26.2 Validating an XHTML document, 

By clicking Browse..., users can select files on their own computers for upload. After 
selecting a file, clicking the Validate this document button uploads and validates the 
file. Figure 26.3 shows the results of validating main.html. This document does not con- 
tain any syntax errors. If a document does contain syntax errors, the validation Service dis- 
plays error messages describing the errors. Figure 26.4 shows the results of validating the 
main.html document, which contains a syntax error—the closing </p> tag is omitted. 
In Exercise 26.13, we askreaders to create an invalid XHTML document (i.e., one that con¬ 
tains syntax errors) and to check the document’s syntax using the validation Service. This 
enables readers to see the types of error messages generated by the validator. 
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Testing and Debugging Tip 26.1 


Use a validation Service, such as the W3C HTML Validation Service, to confirm thatan XHT¬ 
ML document is correct syntactically. 



Fig. 26.3 XHTML validation results ofmain.html containing no syntax errors. 
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4 ^ 


Fig. 26.4 XHTML validation results ofmain.html containing a syntax error, 


26.5 Headers 


Some text in an XHTML document may be more important than others. For example, the 
text in this section is considered more important than a footnote. XHTML provides six 
headers, called header elements, for specifying the relative importance of information. 
Figure 26.5 demonstrates these elements (hl through h6). 



Portability Tip 26.1 

The text size used to display each header element can vary significantly between browsers. 
In Chapter 28, we discuss how to control the text size and other text properties. 
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1 

2 

3 

4 

5 

6 
7 


<?xml version = " 1 . 0 "?> 
<!DOCTYPE html PUBLIC 


<!-- Fig. 26.5: header.html --> 
<!-- XHTML headers --> 


8 

chtml xmlns = "1 



9 

<head> 



10 

<title>Python How to Pr< 

11 

</head> 



12 




13 

<body> 



14 




15 

<hl>Level 

1 

Header :/hl> 

16 

<h2 Level 

2 

header :/h2> 

17 

<h3 Level 

3 

header :/h3> 

18 

<h4 Level 

4 

header :/h4> 

19 

<h5 Level 

5 

header :/h5> 

20 

<h6 Level 

6 

header :/h6> 

21 




22 

</body> 



23 

</html> 




'3 Python How to Program - Headers - Mi' 


.JSI.XI 


File Edit View Favorites Tools Help 


j ^Back - ^ [$») | ^Search 

P»1 Favorites y> 

Address C : \Books\200 1 \pythonhtp 1 \pythonhtp 1 ex w \ ^ Go 

Level 1 Header 


Level 2 header 


Level 3 header 


Level 4 header 


Level 5 header 


Levd 6 heidff 

zl 

Done ^ My Computer 


Fig. 26.5 Header elements hl through h6. 


Header element hl (line 15) is considered the most significant header and is rendered 
in a larger font than the other five headers (lines 16-20). Each successive header element 
(i.e.. h2, h3, etc.) is rendered in a smaller font. 

Look-and-Feel Observation 26.1 

Placing a header at the top ofevery XHTML page helps viewers understand the purpose of 
each page. 
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Look-and-Feel Observation 26.2 


Use larger headers to emphasize more important sections ofa Web page. 


26.6 Linking 

One of the most important XHTML features is the hyperlink, which references (or links to) 
other resources such as XHTML documents and images. In XHTML, both text and images 
can act as hyperlinks. Web browsers typically underline text hyperlinks and color their text 
blue by default, so that users can distinguish hyperlinks from plain text. In Fig. 26.6, we 
create text hyperlinks to four different Web sites. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 
29 


<?xml version = " 1 . 0 "?> 
<!DOCTYPE html PUBLIC 


<!-- Fig. 26.6: links.html --> 

<!-- Introduction to hyperlinks --> 

<html xmlns = "http://www.w3.org/1999/xhtml"> 

<head> 

<title> Python How to Program - Links</title> 

</head> 


<body> 

<hl: Here are my favorite sites</hl> 

<pxstrong>Click a name to go to that page. </strongx/p> 

<!— Create four text hyperlinks --> 


<pxa href 
<pxa href 
<pxa href 
<pxa href 


>Deitel</ax/p> 

>Prentice Hall</ax/p> 
>Yahoo! </ax/p> 

>USA Today</ax/p> 


</body> 
</html> 


Fig. 26.6 Linking to other Web pages (part 1 of 2). 


4 - 
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3 Python How to Program - Links - Microsoft Internet 


File Edit View Favorites Tools Help 
] 4"Back ▼ ^ * £ [$?) ^Search pfcjFavorites ^History 

Address Q C:\Books\2001\pythQnhtp Upythonhtp 1 _examples\ch26\links. 

-----3 

Here are my favorite sites 

Click a name to go to that page. 

Deitel 

Prentice Hali 

Yahoo! 

USA Today 

£] Done 


Fig. 26.6 Linking to other Web pages (part 2 of 2). 

Line 17 introduces the <strong> tag. Browsers typically display text marked up 
with <strong> in abold font. 

Links are created using the a ( anchor) element. Line 20 defines a hyperlink that links 
the text Deitel to the URL assigned to attribute href, which specifies the location of a 
linked resource, such as a Web page, a file or an e-mail address. This particular anchor ele¬ 
ment links to a Web page located at http : //www. deitel. com. When a URL does not 
indicate a specific document on the Web site, the Web server returns a default Web page. 
This pages often is called index.html; however, most Web servers can be configured to 
to use any file as the default Web page for the site. (Open http: / /www.deitel .com 
in one browser window and http: / /www.deitel.com/index.html in a second 
browser window to confirm that they are identical.) If the Web server cannot locate a 
requested document, the server returns an error indication to the Web browser and the 
browser displays an error message to the user. 

Anchors can link to e-mail addresses using a mailto: URL. When someone clicks 
this type of anchored link, most browsers launch the default e-mail program (e.g., Outlook 
Express) to enable the user to write an e-mail message to the linked address. Figure 26.7 
demonstrates this type of anchor. 



JfllxJ 
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1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 


<?xml version = " 1 . 0 "?> 

<!DOCTYPE html PUBLIC 

"http://www.w3.org/TR/xhtmll/DTD/xhtmll-strict.dtd" > 

<!-- Fig. 26.7: contact.html --> 

<!-- Adding email hyperlinks --> 

<html xmlns = "http://wvfw.w3.org/1999/xhtml"> 

<head> 

<title> Python How to Program - Contact Page 

</title> 

</head> 

<body> 

<p: My email address is 

<a href = "mailto:deitel@deitel.com"> 

deitel@deitel.com 

</a> 

. Click the address and your browser will 
open an e-mail message and address it to me. 

</p> 

</body> 

</html> 




Fig. 26.7 Linking to an e-mail address. 
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Lines 17-19 contain an e-mail link. The form of an e-mail anchor is <a href = 
"mai 1 to : emailaddress ">...</ a> . In this case, we link to the e-mail address 

deitel@deitel.com. 


26.7 Images 

The examples discussed so far demonstrated how to mark up documents that contain only 
text. However, most Web pages contain both text and images. In fact, images are an equal, 
if not essential, part of Web-page design. The two most popular image formats used by 
Web developers are Graphics Interchange Format (GIF) and J oint Photographic Experts 
Group (JPEG) images. Users can create images using specialized pieces of Software such 
as Adobe PhotoShop Elements and Jase Paint Shop Pro 5 . Images may also be acquired 
from various Web sites, such as gallery.yahoo.com. Figure 26.8 demonstrates how 
to incorporate images into Web pages. 

Lines 15-16 use an img element to insert an image in the document. The image file’s 
location is specified with the img element’s src attribute. In this case, the image is located 
in the same directory as this XHTML document, so only the image’s file name is required. 
Optional attributes width and height specify the image’s width and height, respec- 
tively. The document author can scale an image by increasing or decreasing the values of 
the image width and height attributes. If these attributes are omitted, the browser uses 
the image’s actual width and height. Images are measured in pixels (“picture elements”), 
which represent dots of color on the screen. The image in Fig. 26.8 is 183 pixels wide and 
238 pixels high. 


1 

<?xml version = "1.0"?> 


2 

<!DOCTYPE html PUBLIC 

'/DTD XHTML 1.0 Strict//EN" 

3 


. 1/DTD/xhtmll-striet.dtd"> 

4 

5 

<!-- Fig. 26.8: picture.html 

--> 

6 

<!-- Adding images with XHTML 

--> 

7 

8 

<html xmlns = "http://www.w3.c 

>rg/1999/xhtml" > 

9 

<head> 


10 

<title>Python How to Program - Welcome :/title> 

11 

</head> 


12 

13 

<body> 


14 

15 

<pximg src = "xmlhtp.jE 

height = "238" width = "183" 

16 

ait = "XML How to 

Program book cover" /> 

17 

<img src = "jhtp.jpg" 

height = "238" width = '183" 

18 

ait = "Java How tc 

> Program book cover" /> 

19 

</p> 


20 

</body> 


21 

</html> 



Fig. 26.8 Placing images in XHTML files (part 1 of 2). 


5. The CD-ROM that accompanies this book contains a 90-day evaluation version of Paint Shop 
Pro™. 
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Fig. 26.8 Placing images in XHTML files (part 2 of 2). 



Good Programming Practice 26.4 

Always include the width and the height of an image inside the <img> tag. When the 
browser loads the XHTML file, it knows immediately from these attributes how much screen 
space to provide for the image and lays out the page properly, even before it downloads the 
image. 



Performance Tip 26.1 

Including the width and height attributes in an <img> tag can resuit in the browser 
loading and rendering pages faster. 


Common Programming Error 26.4 



Entering new dimensionsfor an image that change its inherent width-to-height ratio distorts 
the appearance ofthe image. For example, ifyour image is 200 pixels wide and 100 pixels 
high, you should ensure that any new dimensions have a 2:1 width-to-height ratio. 


Every img element in an XHTML document has an ait attribute. If a browser cannot 
render an image, the browser displays the ait attribute’s value. A browser may not be able 
to render an image for several reasons. It may not support images—as is the case with a 
text-based browser (i.e., a browser that can display only text)—or the client may have dis- 
abled image viewing to reduce download time. Figure 26.8 shows Internet Explorer 5.5 
rendering the ait attribute’s value when a document references a non-existent image file 
(jhtp.jpg). 

Some XHTML elements (called empty elements ) contain only attributes and do not 
markup text (i.e., text is not placed between the start and end tags). Empty elements (e.g., 
img) must be terminated, either by using the forward slash character (/) inside the closing 
right angle bracket (>) of the start tag or by explicitly including the end tag. When using 
the forward slash character, we add a space before the forward slash to improve readability 


4 - 
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(as shown at the ends of lines 16 and 18). Rather than using the forward slash character, 
lines 17-18 could be written with a closing </img> tag as follows: 

<img src = "jhtp.jpg" height = "238' width = "183" 
ait = "Java How to Program book cover"></imgx/p> 

By using images as hyperlinks, Web developers can create graphical Web pages that 
link to other resources. In Fig. 26.9, we create six different image hyperlinks. 


1 

<?xml version = "1.0‘?> 



2 

<!DOCTYPE html PUBLIC 



3 



/xhtmll-strict.dtd"> 

4 




5 

<!-- Fig. 26.9: nav.html 

- 

-> 

6 

<!-- Using images as link 

anchors - 

-> 

7 




8 

<html xmlns = "http://www. 


99/xhtml' > 

9 

<head> 



10 

<title>Python How to 

Program 

- Navigation Bar 

11 

</title> 



12 

</head> 



13 




14 

<body> 



15 




16 

<P> 



17 

<a href = "links... 

html" > 


18 

<img src = 


ks.jpg" width = "65" 

19 

height = "5 

0" ait = 

"Links Page” /> 

20 

</axbr /> 



21 




22 

<a href = "lis h 

tml" > 


23 

<img src = 6f bu 


width = "65" 

24 

height = "5 

" ait = 

"List Example Page" /> 

25 

</axbr /> 



26 




27 

<a href = "contac 

t.html" > 


28 

<img src = 


tact.jpg' width = "65" 

29 

height = "5 

0" ait = 

"Contact Page" /> 

30 

</axbr /> 



31 




32 

<a href = "heder 

. html" > 


33 

<img src = 


des j width = 

34 

height = "5 

0" ait = 

"Header Page /> 

35 

</axbr /> 



36 




37 

<a href = "table. 

html" > 


38 

<img src = 


lt jpg" width = "65" 

39 

height = "5 

0" ait = 

"Table Page" /> 

40 

</axbr /> 



41 




42 

<a href = "form.h 

tml" > 


43 

<img src = "bu 


m.jpg" width = "65" 


Fig. 26.9 Using images as link anchors (part 1 of 2), 
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44 height = 50' ait = "Feedback Foj /> 

45 </axbr /> 

46 </p> 

47 

48 </body> 

49 </html> 




4 ^ 


Fig. 26.9 Using images as link anchors (part 2 of 2). 

Lines 17-20 create an image hyperlink by nesting an img element nested in an anchor 
(a) element. The value of the img element’s src attribute value specifies that this image 
(links . jpg) resides in a directory named buttons. The buttons directory and the 
XHTML document are in the same directory. Images from other Web documents also can 
be referenced (after obtaining permission from the documenfs owner) by setting the src 
attribute to the name and location of the image. 

On line 20, we introduce the br element, which most browsers render as a line break. 
Any markup or text following a br element is rendered on the next line. Like the img ele¬ 
ment, br is an example of an empty element terminated with a forward slash. We add a 
space before the forward slash to enhance readability. 
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26.8 Special Characters and More Line Breaks 

When marking up text, certain characters or symbols (e.g., <) may be difficult to embed 
directly into an XHTML document. Some keyboards may not provide these symbols, or the 
presence of these symbols may cause syntax errors. For example, the markup 

<p>if x < 10 then increment x by l</p> 

results in a syntax error because it uses the less-than character (<), which is reserved for 
start tags and end tags such as <p> and </p>. XHTML provides special characters or en- 
tity references (in the form &code ;) for representing these characters. We could correct the 
previous line by writing 

<p>if x &lt; 10 then increment x by l</p> 

which uses the special character &lt; for the less-than Symbol. Figure 26.10 demonstrates 
how to use special characters in an XHTML document. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 


<?xml version = " 1 . 0 "?> 
<!DOCTYPE html PUBLIC 


<!-- Fig. 26.10: contact2.html --> 

<!— Inserting special characters —> 

<html xmlns = "http://www.w3.org/1999/xhtml"> 

<head> 

<title> Python How to Program - Contact Page 

</title> 

</head> 

<body> 

<!-- special characters are entered --> 

<!-- using the form &code; --> 

<P> 

Click 

<a href = : here 

</a> to open an e-mail message addressed to 
deitel@deitel.com. 

</p> 

<hr /> <!-- inserts a horizontal rule --> 

<p>All information on this site is <strong>&copy; </strong> 
Deitel <strong>&amp; </strong> Associates, Inc. 2002. </p> 

<!— to strike through text use <del> tags --> 

<!— to subscript text use <sub> tags --> 

<!-- to superscript text use <sup> tags --> 

<!-- these tags are nested inside other tags - 


Fig. 26.10 Inserting special characters into XHTML (part 1 of 2). 
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34 <pxdel>You may download 3.14 x 10<sup>2</sup> 

characters worth of information from this site.</del> 

36 Only <sub: one</sub> download per hour is permitted. </p> 

37 

<p>Note: <strong>&lt; &fracl4; </strong> of the information 

39 presented here is updated daily.</p> 

40 

41 </body> 

42 </html> 



Fig. 26.10 Inserting special characters into XHTML (part 2 of 2). 


Lines 27-28 contain other special characters, which are expressed as either word 
abbreviations (e.g., amp for ampersand and copy for Copyright) or hexadecimal (hex) 
values (e.g., &#38; is the hexadecimal representation of &amp;). Hexadecimal numbers 
are base 16 numbers—digits in a hexadecimal number have values from 0 to 15 (a total of 
16 different values). The letters A-F represent the hexadecimal digits corresponding to dec- 
imal values 10-15. Thus in hexadecimal notation we can have numbers like 876 consisting 
solely of decimal-like digits, numbers like DA19F consisting of digits and letters, and num¬ 
bers like DCB consisting solely of letters. We discuss hexadecimal numbers in detail in 
Appendix C, Number Systems. 

In lines 34-36, we introduce three new elements. Most browsers render the dei ele- 
ment as strike-through text. With this format users can easily indicate document revisions. 
To superscript text (i.e., raise text on a line with a decreased font size) or subscript text (i.e., 
lower text on a line with a decreased font size), use the sup and sub elements, respec- 
tively. We also use special characters &lt; for a less-than sign and &fracl4; for the 
fraction 1/4 (line 38). 

In addition to special characters, this document introduces a horizontaI rule , indicated 
by the <hr /> tag in line 24. Most browsers render a horizontal rule as a horizontal line. 
The <hr / > tag also inserts a line break above and below the horizontal line. 


© Copyright 1992-2002 by Deitel & Associates, Inc. AII Rights Reserved. 8/29/01 










































pythonhtpl_26.fm Page 1180 Wednesday, August 29, 2001 3:47 PM 



1180 Introduction to XHTML: Part 1 


Chapter 26 


26.9 Unordered Lists 

Up to this point, we have presented basic XHTML elements and attributes for linking to 
resources, creating headers, using special characters and incorporating images. In this sec- 
tion, we discuss how to organize information on a Web page using lists. In Chapter 27, we 
introduce another feature for organizing information, called a table. Figure 26.11 displays 
text in an unordered list (i.e., a list that does not order its items by letter or number). The 
unordered list element ul creates a list in which each item begins with a bullet symbol 
(called a disc). 

Each entry in an unordered list (element ul in line 20) is an 1 i (list item) element 
(lines 23, 25, 27 and 29). Most Web browsers render these elements with a line break and 
a bullet symbol indented from the beginning of the new line. 


1 

e?xml version = " 1 . 0 "?> 


2 

< ! DOCTYPE html PUBLIC "-//W3C//DTD XHTML 5 


3 

"http://www.w3.org/TR/xhtmll/DTD/xhtml] 

L-strict.dtd"> 

4 



5 

<!-- Fig. 26.11: links2.html 

--> 

6 

7 

8 

<!-- Unordered list containing hyperlinks 

--> 

ehtml xmlns = "http://wviw.w3.org/1999/xhti 

nl > 

9 

<head> 


10 

<title>Python How to Program - Links< /title> 

11 

</head> 


12 



13 

<body> 


14 



15 

<hl>Here are my favorite sites</hl> 


16 



17 

<pxstrong>Click on a name to go to 

that page.e/strongx/p> 

18 



19 

<!-- create an unordered list --> 


20 

<ul> 


21 



22 

<!-- add four list items --> 


23 

elixa href = "httj ://www.deitel, 

>Deitele/ax/li> 

24 



25 

elixa href = "http://www.w3.org' 

>W3Ce/ax/li> 

26 



27 

elixa href = http://www.yahoo.c 

>Yahoo! e/ax/li> 

28 



29 

elixa href = ://www.cnn cor 

CNNe/ax/li> 

30 

e/ul> 


31 

e/body> 


32 

e/html > 



Fig. 26.11 Unordered lists in XHTML (part 1 of 2). 
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Fig. 26.11 Unordered lists in XHTML (part 2 of 2). 


26.10 Nested and Ordered Lists 

Lists may be nested to represent hierarchical relationships, as in an outline format. 
Figure 26.12 demonstrates nested lists and ordered lists (i.e., list that order their items by 
letter or number). 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 


<?xml version = "l.Q"?> 
<!DOCTYPE html PUBLIC 


<!-- Fig. 26.12: list.html --> 

<!-- Advanced Lists: nested and ordered --> 

<html xmlns = "http://www.w3.org/1999/xhtml"> 

<head> 

<title Python How to Program - Lists</title> 

</head> 

<body> 

<hl: The Best Features of the Internet</hl> 

<!-- create an unordered list --> 

<ul> 

<li>You can meet new people from countries around 
the world. </li> 

<li> 

You have access to new media as it becomes public: 

<!-- this starts a nested list, which uses a --> 


Fig. 26.12 Nested and ordered lists in XHTML (part 1 of 3). 
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25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 


<!— modified bullet. The list ends when you --> 
<!-- close the <ul> tag. --> 

<ul> 

<li>New games</li> 

<li> 

New applicatlons 

<!-- ordered nested list --> 

<ol type = "I > 

<li>For business</li> 

<li>For pleasure</li> 

</ol> 

</li> 

<li: Around the clock news</li> 

<li>Search engines</li> 

<li: Shopping</li> 

<li> 

Programming 

<!-- another nested ordered list --> 

<ol type = > 

<li XML </1i> 

<li>Java</li> 

<li XHTML /li> 

<li>Python</li> 

<li New languages</li> 

< / ol> 

</li> 

</ul> <!— ends the nested list of line 27 --> 
</li> 

<li>Links </li> 

<li>Keeping in touch with old friends</li> 

<li>It is the technology of the future! </li> 

</ul> <!-- ends the unordered list of line 18 --> 

<hl>My 3 Favorite <em>CEOs</emx/hl> 

<!— ol elements without a type attribute --> 

<!-- have a numeric seguence type (i.e., 1 , 2 , ...) --> 

<ol> 

<li>Harvey Deitel</li> 

<li>Bill Gates</li> 

<li>Michael Dell</li> 

</ol> 

</body> 

</html> 


Fig. 26.12 Nested and ordered lists in XHTML (part 2 of 3). 
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Fig. 26.12 Nested and ordered lists in XHTML (part 3 of 3). 

The first ordered list begins on line 33. Attribute type specifies the sequence type 
(i.e., the set of numbers or letters used in the ordered list). In this case, setting type to " I" 
specifies upper-case Roman numerals. Line 46 begins the second ordered list and sets 
attribute type to "a", specifying lowercase letters for the list items. The last ordered list 
(lines 64-68) does not use attribute type. By default, the list’s items are enumerated from 
one to three. 

A Web browser indents each nested list to indicate a hierarchal relationship. By 
default, the items in the outermost unordered list (line 18) are preceded by discs. List items 
nested inside the unordered list of line 18 are preceded by circles. Although not demon- 
strated in this example, subsequent nested list items are preceded by squares. Unordered 
list items may be explicitly set to discs, circles or squares by setting the ul element’s type 
attribute to "disc", "circle" or "sguare", respectively. 

Note: XHTML is based on HTML (HyperText Markup Language)—a legacy tech- 
nology of the World Wide Web Consortium (W3C). In HTML, it was common to specify 
the document’s content, structure and formatting. Formatting might specify where the 
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browser places an element in a Web page or the fonts and colors used to display an element. 
The so called striet form of XHTML allows only a document’s content and structure to 
appear in a valid XHTML document, and not that document’s formatting. Our first several 
examples used only the striet form of XHTML. In fact, the purpose of lines 2-3 in each of 
the examples before Fig. 26.12 was to indicate to the browser that each document con- 
formed to the striet XHTML definition. This enables the browser to confirm that the docu¬ 
ment is valid. There are other XHTML document types as well. This particular example 
uses the XHTML transitional document type. This document type exists to enable XHTML 
document creators to use legacy HTML technologies in an XHTML document. In this 
example, the type attribute of the ol element (lines 33 and 46) is a legacy HTML tech- 
nology. Changing lines 2-3 as shown in this example, enables us to demonstrate ordered 
lists with different numbering formats. Normally, such formatting is specified with style 
sheets (Chapter 28). 



Testing and Debugging Tip 26.2 

Most current browsers stili attempt to render XHTML documents, even ifthey are invalid. 


26.11 Internet and World Wide Web Resources 

www.w3.org/TR/xhtml1 

The XHTML 1.0 Recommendation contains XHTML 1.0 general information, compatibility issues, 
document type definition information, definitions, terminology and much more. 

www.xhtml.org 

XHTML.org provides XHTML development news and links to other XHTML resources, which in¬ 
clude books and articles. 

www.w3schools.com/xhtml/default.asp 

The XHTML School provides XHTML quizzes and references. This page also contains links to XHT¬ 
ML syntax, validation and document type definitions. 

validator.w3.org 

This is the W3C XHTML validation Service site. 

hotwired.lycos.com/webmonkey/00/50/index2a.html 

This site provides an article about XHTML. Key sections of the article overview XHTML and discuss 
tags, attributes and anchors. 

wdvl.com/Authoring/Languages/XML/XHTML 

The Web Developers Virtual Library provides an introduction to XHTML. This site also contains ar¬ 
ticles, examples and links to other technologies. 

www.w3.org/TR/1999/xhtml-modularization-19990406/DTD/doc 

The XHTML 1.0 DTD documentation site provides links to DTD documentation for the striet, tran¬ 
sitional and frameset document type definitions. 

SUMMARY 

• XHTML (Extensible Hypertext Markup Language) is a markup language for creating Web pages. 

• A key issue when using XHTML is the separation of the presentation of a document (i.e., the doc¬ 
ument’s appearance when rendered by a browser) from the structure of the information in the doc¬ 
ument. 
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• In XHTML, text is marked up with elements, delimited by tags that are names contained in pairs 
of angle brackets. Some elements may contain additional markup called attributes, which provide 
additional information about the element. 

• A machine that runs specialized piece of Software called a Web server Stores XHTML documents. 

• XHTML documents that are syntactically correct are guaranteed to render properly. XHTML doc¬ 
uments that contain syntax errors may not display properly. 

• Validation Services (e.g., validator.w3 .org) ensure that an XHTML document is syntacti¬ 
cally correct. 

• Every XHTML document contains a start <html> tag and an end </html> tag. 

• Comments in XHTML always begin with < ! - - and end with -->. The browser ignores ali text 
inside a comment. 

• Every XHTML document contains a head element, which generally contains information, such 
as a title, and a body element, which contains the page content. Information in the head element 
generally is not rendered in the display window but may be made available to the user through oth- 
er means. 

• The title element names a Web page. The title usually appears in the colored bar (called the 
title bar) at the top of the browser window and also appears as the text identifying a page when 
users add your page to their list of Favorites or Bookmarks. 

• The body of an XHTML document is the area in which the document's content is placed. The con¬ 
tent may include text and tags. 

• Ali text placed between the <p> and < /p> tags form one paragraph. 

• XHTML provides six headers (hl through h6) for specifying the relative importance of informa¬ 
tion. Header element hl is considered the most significant header and is rendered in a larger font 
than the other five headers. Each successive header element (i.e., h2, h3, etc.) is rendered in a 
smaller font. 

• Web browsers typically underline text hyperlinks and color them blue by default. 

• The <strong> tag renders text in a bold font. 

• Users can insert links with the a (anchor) element. The most important attribute for the a element 
is href , which specifies the resource (e.g., page, file, e-mail address, etc.) being linked. 

• Anchors can link to an e-mail address using a mailto : URL. When someone clicks this type of 
anchored link, most browsers launch the default e-mail program (e.g., Outlook Express) to initiate 
e-mail messages to the linked addresses. 

• The img element’s src attribute specifies an image’s location. Optional attributes width and 
height specify the image width and height, respectively. Images are measured in pixels (“picture 
elements”), which represent dots of color on the screen. Every img element in a valid XHTML 
document rnust have an ait attribute, which contains text that is displayed if the client cannot ren¬ 
der the image. 

• The ait attribute makes Web pages more accessible to users with disabilities, especially those 
with vision impairments. 

• Some XHTML elements are empty elements and contain only attributes and do not mark up text. 
Empty elements (e.g., img) must be terminated, either by using the forward slash character (/) or 
by explicitly writing an end tag. 

• The br element causes most browsers to render a line break. Any markup or text following a br 
element is rendered on the next line. 
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• XHTML provides special characters or entity references (in the form &code ; ) for representing 
characters that cannot be marked up. 

• Most browsers render a horizontal rule, indicated by the <hr / > tag, as a horizontal line. The hr 
element also inserts a line break above and below the horizontal line. 

• The unordered list element ul creates a list in which each item in the list begins with a bullet Sym¬ 
bol (called a disc). Each entry in an unordered list is an li (list item) element. Most Web browsers 
render these elements with a line break and a bullet Symbol at the beginning of the line. 

• Lists may be nested to represent hierarchical data relationships. 

• Attribute type specifies the sequence type (i.e., the set of numbers or letters used in the ordered 
list). 

TERMINOLOGY 

(XHTML comment) 
a element (<a>...</a>) 
ait attribute 

&amp; (& special character) 
anchor 

angle brackets (< >) 

attribute 

body element 

br (line break) element 

comments in XHTML 

fccopy; (© special character) 

disc 

element 
e-mail anchor 
empty tag 

Extensible Hypertext Markup Language (XHTML) 

head element 

header 

header elements (hl through h6) 
height attribute 
hexadecimal code 
<hr /> tag (horizontal rule) 
href attribute 

.htm (XHTML file-name extensioni 
<html> tag 

. html (XHTML file-name extension) 

hyperlink 

image hyperlink 

img element 

level of nesting 

<li> (list item) tag 

linked document 

mailto: URL 

markup language 

nested list 

ol (ordered list) element 
p (paragraph) element 
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special character 
src attribute (img) 

<strong> tag 

sub element 

subscript 

superscript 

syntax 

tag 

text editor 

text editor 

title element 

type attribute 

unordered-list element (ul) 

valid document 

Web page 

width attribute 

World Wide Web (WWW) 

XHTML (Extensible Hypertext Markup Language) 

XHTML comment 

XHTML markup 

XHTML tag 

XML declaration 

xmlns attribute 


SELF-REVIEW EXERCISES 

26. 1 State whether the following are true or false. If false, explain why. 

a) Attribute type, when used with an ol element, specifies a sequence type. 

b) An ordered list cannot be nested inside an unordered list. 

c) XHTML is an acronym for XML HTML. 

d) Element br represents a line break. 

e) Hyperlinks are marked up with <link> tags. 

26.2 Fili in the blanks in each of the following: 

a) The_element inserts a horizontal rule. 

b) A superscript is marked up using element_and a subscript is marked up using 

element_. 

c) The least important header element is_and the most important header element 

is_. 

d) Element_marks up an unordered list. 

e) Element_marks up a paragraph. 

ANSWERS TO SELF-REVIEW EXERCISES 

26. 1 a) True. b) False. An ordered list can be nested inside an unordered list. c) False. XHTML is an 
acronym for Extensible HyperText Markup Language. d) True. e) False. A hyperlink is marked up 
with <a> tags. 

26.2 a) hr . b) sup, sub. c)h6,hl. d)ul. e) p. 

EXERCISES 

26.3 Use XHTML to create a document that contains the to mark up the following text: 
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Python How to Program 

Welcome to the world of Python programming. We have provided extensive coverage on 
Python. 

Use hl for the title (the first line of text), p for text (the second and third lines of text) and sub for 
each word that begins with a capital letter. Insert a horizontal rule between the hl element and the p 
element. Open your new document in a Web browser to view the marked up document. 

26.4 Why is the following markup invalid? 

<p>Here is some text... 

<hr /> 

<p>And some more text...</p> 

26.5 Why is the following markup invalid? 

<p>Here is some text...<br> 

And some more text...</p> 

26.6 An image named deitel. gif is 200 pixels wide and 150 pixels high. Use the width and 
height attributes of the <img> tag to (a) increase the size of the image by 100%; (b) increase the 
size of the image by 50%; and (c) change the width-to-height ratio to 2:1, keeping the width attained 
in part (a). Write separate XHTML statements for parts (a), (b) and (c). 

26.7 Create a link to each of the following: (a) index.html, located in the files directory; 
(b) index.html, located in the text subdirectory of the files directory; (c) index.html, lo¬ 
cated in the other directory in your parent directory [Hint: . . signifies parent directory.]; (d) A 
link to the President of the United States’ e-mail address (president@whitehouse.gov); and 
(e) An FTP link to the file named README in the pub directory of ftp.cdrom.com [Hint: Use 
ftp: //.]. 

26.8 Create an XHTML document that marks up your resume. 

26.9 Create an XHTML document containing three ordered lists: ice cream, soft serve and frozen 
yogurt. Each ordered list should contain a nested, unordered list of your favorite flavors. Provide a 
minimum of three flavors in each unordered list. 

26.10 Create an XHTML document that uses an image as an e-mail link. Use attribute ait to pro¬ 
vide a description of the image and link. 

26.11 Create an XHTML document that contains an ordered list of your favorite Web sites. Your 
page should contain the header “My Favorite Web Sites.” 

26.12 Create an XHTML document that contains links to all the examples presented in this chapter. 
[Hint: Place all the chapter examples in one directory.] 

26.13 Modify the XHTML document (picture.html) in Fig. 26.8 by removing all end tags. 
Validate this document using the W3C validation Service. What happens? Next remove the ait at¬ 
tributes from the <img> tags and revalidate your document. What happens? 

26.14 Identify each of the following as either an element or an attribute: 

a) html. 

b) width. 

c) href. 

d) br. 

e) h3. 

f) a. 

g) src. 
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26.15 State which of the following statements are true and which are false. If false, explain why. 

a) A valid XHTML document can contain uppercase letters in element names. 

b) Tags need not be closed in a valid XHTML document. 

c) XHTML documents can have the file extension . htm. 

d) Valid XHTML documents can contain tags that overlap. 

e) &less ; is the special character for the less-than (<) character. 

f) In a valid XHTML document, <li> can be nested inside either <ol> or <ul> tags. 

26.16 Fili in the blanks for each of the following: 

a) XHTML comments begin with < ! - - and end with_. 

b) In XHTML, attribute values must be enclosed in_. 

c) _is the special character for an ampersand. 

d) Element_can be used to bold text. 

(***DUMP FILE***) 


SELF REVIEW EXERCISES 

26.1 State whether the following are true or false. If false, explain why. 

a) Attribute type, when used with an ol element, specifies a sequence type. 

ANS : True. 

b) An ordered list cannot be nested inside an unordered list. 

ANS : False. An ordered list can be nested inside an unordered list. 

c) XHTML is an acronym for XML HTML. 

ANS : False. XHTML is an acronym for Extensible HyperText Markup Language. 

d) Element br represents a line break. 

ANS : True. 

e) A hyperlink is marked up with <link> tags. 

ANS : False. A hyperlink is marked up with <a> tags. 

26.2 Fili in the blanks in each of the following: 

a) The_element inserts a horizontal rule. 

ANS: hr 

b) A superscript is represented by element_and a subscript is represented by el¬ 
ement _. 

ANS: sup, sub 

c) The least important header element is_and the most important header element 

is_. 

ANS: h6, hl 

d) Element_marks up an unordered list. 

ANS: ul 

e) Element_marks up a paragraph. 

ANS: p 


EXERCISES 

26.3 Use XHTML to mark up the following text: 

Python How to Program 

Welcome to the world of Python programming. We have provided extensive coverage on Python. 
Use hl for the title, p for text and sub for each world that begins with a capital letter. Insert a hori¬ 
zontal rule between the hl element and the p element. 
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ANS: 


1 <?xml version = ?> 

2 <! DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" 

3 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-strict.atd"> 

4 

5 <!-- Exercise 26.3 Solution --> 

6 

7 <html xmlns = "http://www.w3.org/1999/xhtml"> 

8 <head> 

<title>Solution 26.3</title> 

10 </head> 

11 <body> 

12 <hl>Python How to Program</hl> 

13 <hr /> 

14 <pxsub>Welcome c/sub> to the world of <sub; Python :/sub> 

programming. <sub>We< /sub> have provided extensive 

16 coverage on <sub> Python /sub>. 

17 </p> 

18 </body> 

19 </html> 



26.4 Why is the following markup invalid? 

<p>Here's some text... 

<hr /> 

<p>And some more text...</p> 

ANS : According to the XHTML specificatiori, the <p> start tag must have a closing 
</p> tag. 

26.5 Why is the following markup invalid? 

<p>Here's some text...<br> 

And some more text...</p> 

ANS : According to the XHTML specification, the <br> tag must have a closing 
</br> tag or be written as an empty element <br />. 
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26.6 An image named deitel . gif that is 200 pixels wide and 150 pixels high. Use the WIDTH 
and HEIGHT attributes of the IMG tag to 

a) increase image size by 100%; 

ANS: <img src = "deitel.gif" width = "400" height = "300"> 

b) increase image size by 50%; 

ANS: <img src = "deitel.gif" width = "300" height = "225"> 

c) change the width-to-height ratio to 2:1, keeping the width attained in a). 

ANS: <img src = "deitel.gif" width = "400" height = "200"> 

26.7 Create a link to each of the following: 

a) index.html. located in the files directory; 

ANS: <a href = "files/index.html"> 

b) index.html, located in the text subdirectory of the files directory; 

ANS: <a href = "files/text/index.html"> 

c) index. html, located in the other directory in your parent directory ( Hint :. . signi- 
fies parent directory.); 

ANS: <a href = "../other/index.html"> 

d) A link to the President’s email address (president@whitehouse.gov); 

ANS: <a href = "mailto:president@whitehouse.gov"> 

e) An FTP link to the file named README in the pub directory of ftp.cdrom.com 
{Hint: remember to use f tp : / /). 

ANS: <a href = "ftp://ftp.cdrom.com/pub/README"> 

26.8 Create an XHTML document that marks up your resume. 

ANS: 


1 <?xml version = ?> 

2 <!D0CTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" 

3 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-strict.dtd"> 

4 

5 <!-- Exercise 26.8 Solution --> 

6 

7 <html xmlns = "http://www.w3.org/1999/xhtml"> 

8 <head> 

<title>Solution 26.8</title> 

10 </head> 

11 <body> 

12 

13 <!-- heading of Resume --> 

14 

15 <hl>John Doe«br /></hl> 

<h5>Boston College, P0 Box 198, Chestnut Hili, MA 02167 

17 <br /> 

Telephone: (617) 555-0000, E-mail<br /> 

19 <a href= : deitel@bc. edu</a> 

20 <br /> 

21 </h5> 

22 

23 <hr /> <!— inserts a horizontal rule --> 

24 

25 <h2>Objective</h2> 

26 

27 <!-- start of unordered lists --> 
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-7S 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 


<ul> 

<li>A position as an XHTML programmer</li> 

</ul> 

<h2 > Education< /h2 > 

<ul> 

<li>Boston College, Chestnut Hili, MA<br /> 
Computer Science Major, YOG 2003<br /> 
Dean's List Fall 2001, Spring 2001</li> 

< /ul> 

<h2>Skills</h2> 

<ul> 

<li>Computers</li> 

<li>Programming</li> 

<li>Typing, 55WPM* /li> 

<ul> <!-- start of nested list --> 

<li>XHTML c/li> 

<li> Pythone /1i> 

<li>Cascading Style Sheets</li> 

</ul> <!-- end of nested list --> 


47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 


</li> 

<1i> Teamwork </1i> 

</ul> 

<h2>Experience</h2> 

<ul> 

<li>Deitel & Associates 

Sudbury, MA, Summer 2000</li> 
<li>Microsoft, Seattle, WA, Summer 

1999</li> 

<li>Computer Plus, Waltham, MA, 
Spring 1999</li> 

< /ul> 

<h2>Interests and Activities</h2> 

<ul> 

<li>Soccer</li> 

<li>Guitar</li> 

<li>Music</li> 

<li>Student Government </li> 

< /ul> 

<!-- end of unordered lists --> 

<hr /> 

</body> 

</html> 
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26.9 Create an XHTML document containing three ordered lists: ice cream, soft serve and frozen 
yogurt. Each ordered list should contain a nested, unordered of your favorite flavors. Provide a min¬ 
imum of three flavors in each unordered list. 

ANS: 


1 <?xml version = ?> 

2 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" 

3 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-strict.atd"> 

4 

5 <!-- Exercise 26.9 Solution --> 

6 

7 <html xmlns = "http://www.w3.org/1999/xhtml"> 

8 <head> 

<title>Solution 26.9</title> 

10 </head> 

11 <body> 

<h3>My Favorite Ice Cream, Soft Serve and Frozen Yogurt 
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13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 


Flavors</h3> 

<!-- start of ordered list --> 

<ol> 

<li>Ice Cream 

<!— start of nested unordered list --> 
<ul> 

<li: Cherry Garcia</li> 

<li>Cookie Dough</li> 

<li: Bubble Gum</li> 

<li>Coffee</li> 

< /ul > 

</li> 

<li>Soft Serve 

<!— another nested unordered list --> 
<ul> 

<li>Vanilla</li> 

<li: Chocolate</li> 
<li>Strawberry</li> 

< /ul> 

</li> 

<li>Frozen Yogurt 

<!-- another nested unordered list --> 
<ul> 

<li>Vanilla</li> 

<li: Heathbar Crunch</li> 

<li: Chocolate</li> 

< /ul> 

</li> 

</ol> 

</body> 

</html> 
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26.10 Create an XHTML document that uses an image as an e-mail link. Use attribute ait to pro¬ 
vide a description of the image and link. 

ANS: 


1 

<?xml version = "1.0"?> 


2 

<!DOCTYPE html PUBLIC 


3 


>/xhtmll-strict .dtd"> 

4 

5 

<!-- Exercise 26.10 Solution --> 


6 

7 

<html xmlns = "http://www.w3.org/lS 

>99/xhtml > 

8 

<head> 


9 

<title>Solution 26. 10</title> 

10 

</head> 


11 

<body> 


12 

<h3>This is an image that is 

an e-mail link</h3> 

13 

<P> 


14 

<!-- start of e-mail link 

with image --> 

15 

<a href = "mailto:deitel@c 

Leitel. com" > 

16 

< img s r c = ima i 1 j pg 

ait = Deitel 

17 

an e-mail" /></a> 


18 

</p> 


19 

</body> 


20 

</html> 



4 - 
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26.11 Create an XHTML document that contains an ordered list of your favorite Web sites. Your 
page should contain the header “My Favorite Web Sites.” 

ANS: 


1 

<?xml version = "1.0' ?> 


2 

<!DOCTYPE html PUBLIC "-//W3C//DTD XHt 


3 


ltmll-strict.dtd"> 

4 

5 

<!-- Exercise 26.11 Solution --> 


6 

7 

<html xmlns = "http://www.w3.org/1999/ 

'xhtml > 

8 

<head> 


9 

<title>Solution 26. ll</title> 


10 

</head> 


11 

<body> 


12 

<hl My Favorite Websites</hl> 


13 

<P> 


14 

<a href = "http://www.espn.cc 

>ESPN Sports</a> 

15 

</p> 


16 

<P> 


17 

<a href = "http://www.askjee - : 

res. com" > 

18 

Ask Jeeves</a> 


19 

</p> 


20 

<P> 


21 

<a href = "http://www.deitel. 

. corti" > 

22 

Deitel & Associates</a> 


23 

</p> 


24 

<P> 


25 

<a href = "http://www.google. 

>Google</a> 

26 

</p> 


27 

<P> 


28 

<a href = "http://www.hotmai] 

>Hotmail</a> 

29 

</p> 


30 

</body> 


31 

</html> 
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26.12 Create an XHTML document that contains links to ali the examples presented in this chapter. 
[Hint: Place all the chapter examples in one directory.] 

ANS: 



1 

e?xml version = "1,0"?> 



2 

< ! DOCTYPE html PUBLIC 



3 



ct .dtd" > 

4 




5 

A 

<!-- Exercise 26.12 Solution 

--> 


7 

<html> 



8 

<head> 



9 

<title>Solution 26. 12</title> 


10 

</head> 



11 

<body> 



12 

<hl Chapter 26 Example 

Linkse/hl> 


13 

<ul> 



14 

<lixa href = 

>Figure 26.1 

Basic XHTML File 

15 

</ax/li> 

16 

<lixa href = "headi 

>Figure 26. 

5 Headers 

17 

</ax/li> 



18 

<lixa href = 

>Figure 26.6 

Links to 

19 

other Web Pages</ax/li> 


20 

elixa href = "cont 

>Figure 26 

.7 Linking to an 

21 

e-mail address</ax/li> 


22 

elixa href = victi 

>Figure 26 

.8 Placing images 

23 

in XHTML f ilese/ax/li> 


24 

eli>ea href = 

>Figure 26.9 Using images as 

25 

link anchorse/ax/li> 


26 

eli>ea href = "cont; 

>Figure 26.10 

Inserting special 

27 

characters into XHTMLe/ax/li> 


28 

elixa href = 

>Figure 26. 

11 Unordered 
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Lists in XHTML /ax/li> 

<lixa href = >Figure 26.12 Nested and 

31 ordered lists in XHTML</ax/li> 

32 </ul> 

33 </body> 

34 </html> 



26.13 Modify the XHTML document (picture.html) in Fig. 26.8 by removing all end tags. 
Validate this document using the W3C validation Service. What happens? Next remove the ait at- 
tributes from the <img> tags and re-validate your document. What happens? 

ANS: 


1 

<?xml version = "1.0"?> 


2 

<!DOCTYPE html PUBLIC 


3 


.1/DTD/xhtmll-strict.dtd"> 

4 



5 

<!-- Exercise 26.13a Solution 

--> 

6 



7 

<html xmlns = "http://www.w3-c 

>rg/1999/xhtml ; > 

8 

<head> 


9 

<title>Python How to Program - Welcome :/title> 

10 

</head> 


11 



12 

<body> 


13 



14 

<pximg src = "xmlhtp. 

>g" height = "238" width = "183" 

15 

ait = "XML How to Prc 

>gram book cover" > 

16 

<img src = "jhtp.jpg" 

height = "238' width = 183" 
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17 ait = "Java How to Program book cover"> 

18 </body> 

19 </html> 


3 W3C HTML Validation Service Results - Microsoft Internet Explorer 

-1Q1.X1 

File Edit View Favorites Tools Help 


'J 3 Back » ^ Sl £tSearch gj Favorites ^History ££ liffl - f^l & iR 

Address |$£] http://validator.w3.org/check 

»J r>G< 

'J 

HTML Validation Service Results 



Document Checked 




• File: C:\Books\2001\pythonhtpl\pythonhtpl_solutions\ch26\ex26_13a.html 

• Character encoding: unknown 

• Document type: XHTML 1.0 Striet with namespace http://www.w3. org/1999/xhtml 
Below are the results of checking this document for XML well-formedness and validity. 

• Line 15, column48: 

ait = "XML How to Program book cover" > 



e 


Error: end tag for "img" omitte d; end tags are re quire d in XML for non-empty elements; empty elements require 
an end tag or the start tag must end with "/>" ^ | 

|$ Internet 
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1 

<?xml version = " 1 . 0 "?> 


2 

<!DOCTYPE html PUBLIC 


3 



4 

5 

<!-- Exercise 26.13b Solution --> 

6 

7 

<html xmlns = "http-j 

/w.w3.org/1999/xhtml "> 

8 

<head> 


9 

<title>Python How 

to Program - Welcome /title> 

10 

</head> 


11 

12 

<body> 


13 

14 

<pximg src = 

ihtp.jpg" height = "238" 

15 

width = "18 

/> 

16 

<img src = "jht 

jpg" height = "238" 

17 

width = "18: 

1" /></p> 

18 

</body> 


19 

</html> 
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26.14 Identify each of the following as either an element or an attribute: 

a) html 

ANS: Element. 

b) width 

ANS: Attribute. 

c) href 

ANS: Attribute. 

d) br 

ANS: Element. 

e) h3 

ANS: Element. 

f) a 

ANS: Element. 

g) src 

ANS: Attribute. 

26.15 State which of the following statements are true and which are false. If false, explain why. 

a) A valid XHTML document can contain uppercase letters in element names. 

ANS: False. All XHTML element names must be in lowercase. 

b) Tags need not be closed in a valid XHTML document. 

ANS: False. All XHTML tags are required to have corresponding closing tags. 

c) XHTML can have the file extension. htm. 

ANS: True. 

d) Valid XHTML documents can contain tags that overlap. 

ANS: False. XHTML prohibits overlapping tags. 

e) &less; is the special character for the less-than (<) character. 

ANS: False. &lt ; is the special character for less-than. 

f) In a valid XHTML document, <li> can be nested inside either <ol> or <ul> tags. 
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ANS : True. 

26.16 Fili in the blanks for each of the following: 

a) XHTML comments begin with < ! - - and end with_ 

ANS: —>. 

b) In XHTML, attribute values must be enclosed in_ 

ANS : quotes (single or double). 

c) _is the special character for an ampersand. 

ANS: &amp;. 

d) Element_can be used to bold text. 

ANS: strong. 

e) <?xml version = "1.0" ?> is called the_ 

ANS : XML declaration. 
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[***Notes To Reviewers***] 

• This chapter will be sent for second-round reviews. 

• Please mark your comments in place on a paper copy of the chapter. 

• Please return only marked pages to Deitel & Associates, Inc. 

• Please do not send us e-mails with detailed, line-by-line comments; mark these directly on the pa¬ 
per pages. 

• Please feel free to send any lengthy additional comments by e-mail to cheryl. yaeger@dei- 
tel.net. 

• Please run ali the code examples. 

• Please check that we are using the correct programming idioms. 

• Please check that there are no inconsistencies, errors or omissions in the chapter discussions. 

• The manuscript is being copyedited by a professional copy editor in parallel with your reviews. 
That person will probably find most typos, spelling errors, grammatical errors, etc. 

• Please do not rewrite the manuscript. We are concemed mostly with technical correctness and cor¬ 
rect use of idiom. We will not make significant adjustments to our writing style on a global scale. 
Please send us a short e-mail if you would like to make such a suggestion. 

• Please be constructive. This book will be published soon. We all want to publish the best possible 
book. 

• If you find something that is incorrect, please show us how to correct it. 

• Please read all the back matter including the exercises and any Solutions we provide. 

• Please review the index we provide with each chapter to be sure we have covered the topics you 
feel are important. 
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Objectives 

• To create tables with rows and columns of data. 

• To control table formatting. 

• To create and use forms. 

• To create and use image maps to aid in Web-page 
navigation. 

• To make Web pages accessible to search engines 
using <meta> tags. 

• To se the f rameset element to display multiple 
Web pages in a single browser window. 

Yea, from the table of my memory 
I’ll wipe away ali trivial fond records. 

William Shakespeare 



Under 

Constructi on 
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Outline 

27.1 

Introduction 

27.2 

Basic XHTML Tables 

27.3 

Intermediate XHTML Tables and Formatting 

27.4 

Basic XHTML Forms 

27.5 

More Complex XHTML Forms 

27.6 

Internal Linking 

27.7 

Creating and Using Image Maps 

27.8 

meta Elements 

27.9 

f rameset Element 

27.10 

Nested framesetS 

27.11 

Internet and World Wide Web Resources 

Summary • Terminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 


27.1 Introduction 

In the previous chapter, we introduced XHTML. We built several complete Web pages fea- 
turing text, hyperlinks, images, horizontal rules and line breaks. In this chapter, we discuss 
more substantial XHTML features, including presentation of information in tables and in- 
corporating forms for collecting information from a Web-page visitor. We also introduce 
internal linking and image maps for enhancing Web page navigation and fi'rames for dis- 
playing multiple documents in the browser. 

By the end of this chapter, you will be familiar with the most commonly used XHTML 
features and will be able to create more complex Web documents. In Chapter 28, we dis¬ 
cuss how to make Web pages more visually appealing by manipulating fonts, colors and 
text. 


27.2 Basic XHTML Tables 

This section presents XHTML tables —a frequently used feature that organizes data into 
rows and columns. Our first example (Fig. 27.1) uses a table with six rows and two columns 
to display price information for fruit. 


1 <?xml version = ?> 

2 < l DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Striet//EN 

3 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-strict.dtd"> 

4 

5 <!-- Fig. 27.1: tablel.html --> 

6 <!— Creating a basic table --> 

7 


Fig. 27.1 XHTML table (part 1 of3). 
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8 

<html xmlns = "http://www.w3.org/li 

?99/xhtml > 

9 

<head> 


10 

<title>A simple XHTML table</title> 

11 

</head> 


12 



13 

<body> 


14 



15 

<!-- the <table> tag opens a 

table --> 

16 

ctable border = width = 


17 

summary = "This table prcr\ 


18 

the price of fruit"> 


19 



20 

<!-- the <caption> tag summarizes the table's 

21 

<!-- contents (this helps 

the visually impaired) -■ 

22 

<captionxstrong>Price of 

Fruit</strongx/caption> 

23 



24 

<!-- the <thead> is the first section of a table -■ 

25 

<!— it formats the table 

header area 

26 

<thead> 


27 

<tr> <!-- 

<tr> inserts a table row 

28 

<th>Fruit</th> 

insert a heading cell 

29 

<th>Price</th> 


30 

</tr> 


31 

</thead> 


32 



33 

<!-- all table content is 

enclosed --> 

34 

<!-- within the <tbody> 

--> 

35 

<tbody> 


36 

<tr> 


37 

<td>Apple</td> 

insert a data cell --> 

38 

<td>$0 . 25</td> 


39 

</tr> 


40 



41 

<tr> 


42 

<td>Orange /td> 


43 

<td>$0 . 50</td> 


44 

</tr> 


45 



46 

<tr> 


47 

<td>Banana /td> 


48 

<td>$l.00</td> 


49 

</tr> 


50 



51 

<tr> 


52 

<td>Pineapple</td> 


53 

<td>$2 . 00</td> 


54 

</tr> 


55 

</tbody> 


56 



57 

<!-- the <tfoot> is the last section of a table 

58 

<!-- it formats the table 

footer 

59 

<tfoot> 


60 

<tr> 



Fig. 27.1 XHTML table (part 2 of 3). 
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61 <th>Total</th> 

62 <th>$3 . 75</th> 

63 </tr> 

64 </tfoot> 

65 

66 </table> 

67 

68 </body> 

69 </html> 



Table 

header 


Table 

footer 

Table 

border 


Fig. 27.1 XHTML table (part 3 of 3). 


Tables are defined with the table element. Lines 16-18 specify the start tag for a 
table element that has several attributes. The border attribute specifies the table’ s border 
width in pixels. To create a table without a border, set border to "0". This example 
assigns attribute width "40V to set the table’s width to 40 percent of the browser’s 
width. A developer can also set attribute width to a specified number of pixels. 



Testing and Debugging Tip 27.1 

Try resizing the browser window to see how the width ofthe window ajfects the width ofthe 
table. 


As its name implies, attribute summary (line 17) describes the table’s contents. 
Speech devices use this attribute to make the table more accessible to users with visual 
impairments. The caption element (line 22) describes the table’s content and helps text- 
based browsers interpret the table data. Text inside the <caption> tag is rendered above 
the table by most browsers. Attribute summary and element caption are two of many 
XHTML features that make Web pages more accessible to users with disabilities. 

A table has three distinet sections— head, body and foot. The head section (or header 
cell) is defined with a thead element (lines 26-31), which contains header information 
such as column names. Each tr element (lines 27-30) defines an individual table row. The 
columns in the head section are defined with th elements. Most browsers center and dis- 
play text formatted by th (table header column) elements in bold. Table header elements 
are nested inside table row elements. 
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The body section, or table body, contains the table’s primary data. The table body 
(lines 35-55) is defined in a tbody element. Data cells contain individual pieces of data 
and are defined with td ( table data) elements. 

The foot section (lines 59-64) is defined with a tfoot (table foot) element and rep- 
resents a footer. Common text placed in the footer includes calculation results and foot- 
notes. Like other sections, the foot section can contain table rows and each row can contain 
columns. 

27.3 Intermediate XHTML Tables and Formatting 

In the previous section, we explored the structure of a basic table. In Fig. 27.2, we enhance 
our discussion of tables by introducing elements and attributes that allow the document au- 
thor to build more complex tables. 

The table begins on line 17. Element colgroup (lines 22-27) groups and formats 
columns. The coi element (line 26) specifies two attributes in this example. The align 
attribute determines the alignment of text in the column. The span attribute determines 
how many columns the coi element formats. In this case, we set align’ s value to 
"right" and span’s value to "1" to right-align text in the first column (the column con- 
taining the picture of the camel in the sample screen capture). 

Table cells are sized to fit the data they contain. Document authors can create large 
data cells by using attributes rowspan and coi span. The values assigned to these 
attributes specify the number of rows or columns occupied by a cell. The th element in 
lines 36-39 uses the attribute rowspan = " 2 " to allow the cell containing the picture of 
the camel to use two vertically adjacent cells (thus the cell spans two rows). The th ele¬ 
ment in lines 42-45 uses the attribute coi span = " 4 " to widen the header cell (containing 
Camel id compari son and Approximate as of 9/2002) to span four cells. 


1 

<?xml version = " 1 . 0 ”?> 


2 

<!DOCTYPE html PUBLIC 


3 


)/xhtmll-strict.dtd"> 

4 

5 

<!-- Fig. 27.2: table2.html --> 


6 

7 

8 

<!-- Intermediate table design --> 


<html xmlns = "http://www.w3.org/li 

J99/xhtml > 

9 

<head> 


10 

<title>Python How to Program 

- Tables</title> 

11 

</head> 


12 

13 

<body> 


14 

15 

<hl>Table Example Page</hl> 


16 

17 

<table border = " 1 "> 


18 

ccaption: Here is a more complex sample table. </caption> 

19 

20 

<!-- <colgroup> and <col> 

tags are used to --> 


Fig. 27.2 Complex XHTML table (part 1 of 3). 
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21 

<!-- format entire colurnus — > 


22 

<colgroup> 


23 



24 

<!-- span attribute determines how many columns 

--> 

25 

<! — the <col> tag affects 

--> 

26 

<col align = "right" span = "1" /> 


27 

</colgroup> 


28 



29 

<thead> 


30 



31 

<!-- rowspans and colspans merge the specified 

-> 

32 

<!-- number of cells vertically or horizontally 

-> 

33 

<tr> 


34 



35 

<!-- merge two rows --> 


36 

<th rowspan = '2' > 


37 

<img src = "camel.gif" width = '205" 


38 

height = "167' ait = "Picture of a came 

i" /> 

39 

</th> 


40 



41 

<!-- merge four columns --> 


42 

<th colspan = valign = > 


43 

<hl>Camelid comparisonc/hlxbr /> 


44 

<p> Approximate as of 9/2002</p> 


45 

</th> 


46 

</tr> 


47 



48 

<tr valign = "bot. > 


49 

<th># of Humps</th> 


50 

<th>Indigenous region</th> 


51 

<th>Spits?</th> 


52 

<th>Produces Wool?</th> 


53 

</tr> 


54 



55 

</thead> 


56 



57 

<tbody> 


58 



59 

<tr> 


60 

<th>Camels (bactrian) </th> 


61 

<td>2</td> 


62 

<td>Af rica/Asia</td> 


63 

<td rowspan = >Llama </td> 


64 

<td rowspan = >Llamac/td> 


65 

</tr> 


66 



67 

<tr> 


68 

<th>Llamas</th> 


69 

<td>l</td> 


70 

<td> Andes Mountains</td> 


71 

</tr> 


72 



73 

</tbody> 


Fig. 27.2 

Complex XHTML table (part 2 of 3). 
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75 ' “ — - 

75 </table> 

76 

77 </body> 

78 </html> 



Fig. 27.2 Complex XHTML table (part 3 of 3). 

_Common Programming Error 27.1 

When using colspan and rowspan to adjust the size of table data cells, keep in mind that 
-rJ— the modified cells will occupy more than one column or row. Other rows or columns ofthe 
table must compensate for the extra rows or columns spanned by individuaI cells. Ifyou do 
not, the formatting ofyour table will be distorted andvou may inadvertently create more col¬ 
umns and rows than you originally intended. 

Line 42 introduces attribute valign , which aligns data vertically and may be 
assigned one of four values— "top" aligns data with the top of the cell, "middle" ver¬ 
tically centers data (the default for all data and header cells), "bottom" aligns data with 
the bottom of the cell and "baseline" ignores the fonts used for the row data and sets 
the bottom of all text in the row on a common baseline (i.e., the horizontal line to which 
each character in a word is aligned). 


4 - 


27.4 Basic XHTML Forms 

When browsing Web sites, users often need to provide information such as e-mail address- 
es, search keywords and zip codes. XHTML provides a mechanism, called a form, for col- 
lecting such user information. 


© Copyright 1992-2002 by Deitel & Associates, Inc. All Rights Reserved. 8/29/01 




















































pythonhtpl_27.fm Page 1212 Wednesday, August 29, 2001 3:45 PM 



1212 Introduction to XHTML: Part 2 


Chapter 27 


Data that users enter on a Web page normally is sent to a Web server that provides 
access to a site’s resources (e.g., XHTML documents, images, etc.). These resources are 
either located on the same machine as the Web server or on a machine that the Web server 
can access through the network. When a browser requests a Web page or file that is located 
on a server, the server processes the request and returns the requested resource. A request 
contains the name and path of the desired resource and the method of communication 
(called a protocol). XHTML documents use the HyperText Transfer Protocol (HTTP). 

Figure 27.3 sends the form data to the Web server which passes the form data to a CGI 
(Common Gateway Interface) script (i.e., a program) written in Perl, C or some other lan- 
guage. The script processes the data received from the Web server and typically returns 
information to the Web server. The Web server then sends the information in the form of 
an XHTML document to the Web browser. [Note: This example demonstrates client-side 
functionality. If the form is submitted (by clicking Submit Your Entries ) an error occurs. 
In later chapters such as Perl and Python, we present the server-side programming neces- 
sary to process information entered into a form. ] 


1 

<?xml version = 0' ?> 


2 

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1 


3 


-striet.dtd"> 

4 



5 

6 

7 

8 

<!-- Fig. 27.3: form.html --> 

<!-- Form Design Example 1 — > 


<html xmlns = "http://www.w3.org/1999/xhtm: 

> 

9 

<head> 


10 

<title>Python How to Program - Forms /title> 

11 

</head> 


12 



13 

<body> 


14 



15 

<hl>Feedback Form</hl> 


16 



17 

<p>Please fili out this form to help 


18 

us improve our site.</p> 


19 



20 

<!-- this tag starts the form, gives 

the --> 

21 

<!-- method of sending information and the --> 

22 

<!— location of form Scripts 

--> 

23 

<form method = "post" action = 

-bin/ f ormmail" > 

24 


25 

<P> 


26 

<!-- hidden inputs contain non- 

-visual --> 

27 

<!-- information 

--> 

28 

<input type = "hidden* name = 


29 

value = "deitel@deitel.com" 

/> 

30 

<input type = "hidden" name = 


31 

value = Feedback For /> 


32 

<input type = "hidden" name = 


33 

value = in.hti /> 



Fig. 27.3 Simple form with hidden fields and a text box (part 1 of 2). 


4 - 
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35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 


</p> 

<!— <input type = "text"> inserts a text box --> 

<pxlabel>Name : 

<input name = type = size = 

maxlength = "30" /> 

</labelx/p> 


<P> 


<!-- input types 

"submit" and "reset" insert 

--> 

<!-- buttons for 

submitting and clearing the 

--> 

<!-- form's contents 

--> 

<input type = 

lbmit" value = 



Sntries" /> 


<input type = 

value = 



ltries" /> 



</form> 

</html> 



Fig. 27.3 Simple form with hidden fields and a text box (part 2 of 2). 

Fornis can contain visual and non-visual components. Visual components include 
clickable buttons and other graphical user interface components with which users interact. 
Non-visual components, called hidden inputs, store data that the document author specifies, 
such as e-mail addresses and XHTML document file names that act as links. The form 
begins on line 23 with the form element. Attribute method specifies how the form’s data 
is sent to the Web server. 

Using method = "post " appends form data to the browser request, which contains 
the protocol (i.e., HTTP) and the requested resource’s URL. Scripts located on the Web 
server’s computer (or on a computer accessible through the network) can access the form 
data sent as part of the request. For example, a script may take the form information and 
update an electronic mailing list. The other possible value, method = "get" appends the 


4 - 
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form data directly to the end of the URL. For example, the URL /cgi-bin/formmail 
might have the form information nane = bob appended to it. 

The action attribute in the <form> tag specifies the URL of a script on the Web 
server; in this case, it specifies a script that e-mails form data to an address. Most Internet 
Service Providers (ISPs) have a script like this on their site; ask the Web site system admin¬ 
istrator how to set up an XHTML document to use the script correctly. 

Lines 28-33 define three input elements that specify data to provide to the script that 
processes the form (also called th e form handler). These three input element have type 
attribute "hidden" , which allows the document author to send form data that is not 
entered by a user to a script. 

The three hidden inputs are: an e-mail address to which the data will be sent, the e- 
mail’s subject line and a URL where the browser will be redirected after submitting the 
form. Two other input attributes are name, which identifies the input element, and 
value, which provides the value that will be sent (or posted) to the Web server. 



Good Programming Practice 27.1 

Place hidden input elements at the beginning of a form, immediately after the opening 
<form> tag. This placement allows document authors to locate hidden input elements 
quickly. 


We introduce another type of input in lines 38-39. The "text " input inserts a 
text box into the form. Users can type data in text boxes. The label element (lines 37-40) 
provides users with information about the input element’s purpose. 



. Common Programming Error 27.2 


Forgetting to include a label element for eochform element is a design error. Without 
these labeis, users cannot determine the purpose of individual form elements. 


The input element’s size attribute specifies the number of characters visible in the 
text box. Optional attribute maxlength limits the number of characters input into the text 
box. In this case, the user is not permitted to type more than 3 0 characters into the text box. 

There are two types of input elements in lines 46-49. The "submit" input ele¬ 
ment is a button. When the user presses a " submit " button, the browser sends the data in 
the form to the Web server for processing. The value attribute sets the text displayed on 
the button (the default value is Submit). The "reset " input element allows a user to 
reset ali form elements to their default values. The value attribute of the "reset" 
input element sets the text displayed on the button (the default value is Reset). 


27.5 More Complex XHTML Forms 

In the previous section, we introduced basic forms. In this section, we introduce elements 
and attributes for creating more complex forms. Figure 27.4 contains a form that solicits 
user feedback about a Web site. 

The text area element (lines 37-39) inserts a multiline text box, called a text area, 
into the form. The number of rows is specified with the rows attribute and the number of 
columns (i.e., characters) is specified with the cois attribute. In this example, the tex- 
tarea is four rows high and 36 characters wide. To display default text in the text area, 
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place the text between the <textarea> and </textarea> tags. Default text can be 
specified in other input types, such as text boxes, by using the value attribute. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 


<?xml version = " 1 . 0 "?> 
<!DOCTYPE html PUBLIC 


<!-- Fig. 27.4: form2.html --> 

<!-- Form Design Example 2 --> 

<html xmlns = 'http://www.w3.org/1999/xhtml"> 

<head> 

<title> Python How to Program - Forms :/title> 

</head> 

<body> 

<hl>Feedback Form</hl> 

<p>Please fili out this form to help 
us improve our site.</p> 

<form method = action = "/cgi-bin/formmail"> 

<P> 

<input type 
value = 

<input type 
value = 

<input type 
value = 

</p> 

<pxlabel>Name : 

<input name = 'name' type = 'text size = "25" /> 
</labelx/p> 

<!— <textarea> creates a multiline textbox --> 

<pxlabel>Comments : <br /> 

<textarea name = rows = cois = > 

Enter your comments here. 

</textarea> 

</labelx/p> 

<!— cinput type = "password"> inserts a --> 

<!-- textbox whose display is masked with --> 

<!-- asterisk characters --> 

<pxlabel>E-mail Address: 

<input name = "email" type = "password" 
size = "25 /> 

</labelx/p> 


name = "re 

el.com" /> 

name = 

irm" /> 
name = "re- 
/> 


4 - 


Fig. 27.4 Form with textareas, password boxes and checkboxes (part 1 of 3). 
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50 

<P> 



51 

<strong>Things 

you liked: </strongxbr /> 

52 




53 

<label>Site design 


54 

<input nane = 

"thingsliked" type 

= "checl 

55 

value = "De 

sign" /></label> 


56 




57 

<label>Links 



58 

<input nane = 

rsliked" type 

= "checl 

59 

value = "Li 

/></label> 


60 




61 

<label>Ease of 

use 


62 

<input nane = 

rsliked" type 

= "checl 

63 

value = "Ea 

/></label> 


64 




65 

<label>Images 



66 

<input nane = 

rsliked" type 

= "checl 

67 

value = 

/></label> 


68 




69 

<label>Source 

code 


70 

<input nane = 

rsliked" type 

= "checl 

71 

value = 

/></label> 


72 

</p> 



73 




74 

<P> 



75 

<input type = 

submit" value = 


76 


r Entries" /> 


77 

<input type = 

value = 


78 


Entries' /> 


79 

</p> 



80 




81 

</form> 



82 

</html> 





4 - 


Fig. 27.4 Form with textareas, password boxes and checkboxes (part 2 of 3). 


© Copyright 1992-2002 by Deitel & Associates, Inc. AII Rights Reserved. 8/29/01 































pythonhtpl_27.fm Page 1217 Wednesday, August 29, 2001 3:45 PM 


Chapter 27 


Introduction to XHTML: Part 2 




Fig. 27.4 Form with textareas, password boxes and checkboxes (part 3 of 3). 


1217 


© Copyright 1992-2002 by Deitel & Associates, Inc. AII Rights Reserved. 8/29/01 































































pythonhtpl_27.fm Page 1218 Wednesday, August 29, 2001 3:45 PM 



1218 Introduction to XHTML: Part 2 


Chapter 27 


The "password" input in lines 46-47, inserts a password box with the specified 
size. A password box allows users to enter sensitive information, such as credit card num- 
bers and passwords, by “masking” the information input with asterisks. The actual value 
input is sent to the Web server, not the asterisks that mask the input. 

Lines 54-71 introduce the checkbox formelement. Checkboxes enable users to select 
from a set of options. When a user selects a checkbox, a check mark appears in the check 
box. Otherwise, the checkbox remains empty. Each "checkbox" input creates a new 
checkbox. Checkboxes can be used individually or in groups. Checkboxes that belong to a 
group are assigned the same name (in this case, "thingsliked"). 


Common Programming Error 27.3 



When your form has several checkboxes with the sanie name, you must make sure that they 
have different values, or the Scripts running on the Web sen>er will not be able to distin- 
guish betw>een them. 


We continue our discussion of forms by presenting a third example that introduces sev¬ 
eral more form elements from which users can make selections (Fig. 27.5). In this example, 
we introduce two new input types. The first type is the radio button (lines 76-94) spec¬ 
ified with type "radio". Radio buttons are similar to checkboxes, except that only one 
radio button in a group of radio buttons may be selected at any time. All radio buttons in a 
group have the same name attributes and are distinguished by their different value 
attributes. The attribute-value pair checked = "checked" (line 77) indicates which 
radio button, if any, is selected initially. The checked attribute also applies to check¬ 
boxes. 


1 

<?xml version = "] 0' ?> 



2 

<!DOCTYPE html PUBLIC 



3 



> 

4 




5 

<!-- Fig. 27.5: form3.html --> 



6 

<!-- Form Design Example 3 — > 



7 




8 

<html xmlns = "http://www.w3.org/15 

)99/xhtml > 


9 

<head> 



10 

<title>Python How to Program 

- Forms /title> 


11 

</head> 



12 




13 

<body> 



14 




15 

<hl>Feedback Form</hl> 



16 




17 

<p>Please fili out this form 

to help 


18 

us improve our site.</p> 



19 




20 

<form method = "post action 

_ i'/r*gi -bi ti/ f^rrrim 

ail" > 

21 



22 

<P> 



23 

cinput type = "hidden" 

name = "recipient 


24 

value = "deitel@deit 

:el.com" /> 



Fig. 27.5 Form including radio buttons and drop-down lists (part 1 of 5). 


4 - 
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25 

<input type = "hiddi 

en" name = "subject" 

26 

value = dbacl 

k Form" /> 

27 

<input type = "hiddi 

en" name = "redirect" 

28 

value = ir hti 

/> 

29 

</p> 


30 



31 

<pxlabel>Name : 


32 

<input name = "ni 

ame" type = xt" size = "25" /> 

33 

</labelx/p> 


34 



35 

<pxlabel>Comments: <br 

/> 

36 

<textarea name = 

"comments" rows = "4" 

37 

cois = "36"x/textarea> 

38 

</labelx/p> 


39 



40 

<pxlabel>E-mail Address: 

41 

<input name = "ei 

1" type = "password" 

42 

size = "25 /x/labelx/p> 

43 



44 

<P> 


45 

<strong>Things you : 

liked: </strongxbr /> 

46 



47 

<label>Site design 


48 

<input name = "t 

liingsliked" type = "checkbox" 

49 

value = "Desi 

gn" /x/label> 

50 



51 

<label>Links 


52 

<input name = 

liingsliked" type = "checkbox" 

53 

value = "Linki 

s" /x/label> 

54 



55 

<label>Ease of use 


56 

<input name = "t 

liingsliked" type = "checkbox" 

57 

value = "Ease 

/x/label> 

58 



59 

<label> Images 


60 

<input name = "t 

liingsliked" type = "checkbox" 

61 

value = " Imagi 

/x/label> 

62 



63 

<label>Source code 


64 

<input name = "t 

liingsliked" type = "checkbox" 

65 

value = "Code 

/x/label> 

66 

</p> 


67 



68 

<!-- <input type = "radio" /> creates a radio --> 

69 

<!-- button. The difference between radio buttons --> 

70 

<!-- and checkboxes is 

that only one radio button --> 

71 

<!— in a group can be 

selected. --> 

72 

<P> 


73 

<strong How did you 

get to our site?: </strongxbr /> 

74 



75 

<label>Search engine 

76 

<input name = 

awtosite" type = "radio" 

77 

value = "sean 

ch engine" checked = "checked" /> 


Fig. 27.5 Form including radio buttons and drop-down lists (part 2 of 5). 
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78 

79 

80 
81 
82 

83 

84 

85 

86 

87 

88 

89 

90 

91 

92 

93 

94 

95 

96 

97 

98 

99 

100 
101 
102 

103 

104 

105 

106 

107 

108 

109 

110 
111 
112 

113 

114 

115 

116 

117 

118 

119 

120 
121 
122 

123 

124 

125 

126 

127 

128 

129 

130 


</label> 

<label>Links from another site 

cinput name = "howtosite" type = 
value = "link" /></label> 


<label:-Deitel .com Web site 

<input name = "howtosite" type = 
value = "deitel.com" /></label> 


<label>Ref erence in a book 


<input name 
value = 


type = 
/></label> 


<label >0ther 
<input name 
value = 


:osite" type = 
/></label> 


</p> 

<P> 

<label>Rate our site: 

<!— the <select> tag presents a drop-down --> 
<!-- list with choices indicated by the --> 
<!-- <option> tags --> 

<select name = "rating"» 

coption selected = >Amazing</option> 

<option>10</option> 

<option>9</option> 

<option> 8< /option> 

<option>7 </option> 

<option> 6< /option> 

<option>5</option> 

<option>4</option> 

<option>3</option> 

<option>2</option> 

<option>l</option> 

<option>Awf ul< /option> 

</select> 

</label> 

</p> 

<P> 

<input type = "subnt.it" value = 

"Submit Your Entries" /> 

<input type = "reset" value = "Ciear Your Entries" /> 

</p> 

</form> 

</body> 


4 - 


Fig. 27.5 Form including radio buttons and drop-down lists (part 3 of 5). 
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131 </html> 



Fig. 27.5 Form including radio buttons and drop-down lists (part 4 of 5). 
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Fig. 27.5 Form including radio buttons and drop-down lists (part 5 of 5). 


Common Programming Error 27.4 



When using a group of radio buttons in a form, forgetting to set the name attributes to the 
same name lets the user select ali ofthe radio buttons at the same time, which is a logic er- 


The select element (lines 104-117) provides a drop-down list of items from which 
the user can select an item. The name attribute identifies the drop-down list. The option 
element (lines 105-116) adds items to the drop-down list. The option element’s 
selected attribute specifies which item initially is displayed as the selected item in the 
select element. 


4 - 
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27.6 Internal Linking 

In Chapter 26, we discussed how to hyperlink one Web page to another. Figure 27.6 intro¬ 
duces internal linking —a mechanism that enables the user to jump between locations in the 
same document. Internal linking is useful for long documents that contain many sections. 
Clicking an internal link enables users to find a section without scrolling through the entire 
document. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 


<?xml version = " 1 . 0 ”?> 
<!DOCTYPE html PUBLIC 


<!-- Fig. 27.6: links.html --> 

<!-- Internal Linking --> 

<html xmlns = "http://www.w3.org/1999/xhtml"> 

<head> 

<title> Python How to Program - List</title> 

</head> 

<body> 

<!-- <a name = ".."></a> creates an internal hyperlink --> 

<pxa name = "featu; ></ax/p> 

<hl>The Best Features of the Internet</hl> 

<!-- an internal link's address is "ttlinkname" --> 

<pxa href = >Go to <em>Favorite CEOs</emx/ax/p> 

<ul> 

<li>You can meet people from countries 
around the world. </li> 

<li>You have access to new media as it becomes public: 

<ul> 

<li>New games</li> 

<li>New applications 

<ul> 

<li>For Business</li> 

<li>For Pleasure</li> 

< /ul> 

</li> 

<1i: Around the clock news</li> 

<li>Search Engines</li> 

<li: Shopping</li> 

<li>Programming 

<ul> 

<li XHTML /li> 

<li>Java</li> 

<li>Python</li> 


Fig. 27.6 Using internal hyperlinks to make pages more navigable (part 1 of 3). 
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44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 


<li>Scripts</li> 

<li>New languages</li> 

< /ul> 

</li> 

< /ul > 

</li> 

<li>Links</li> 

<li>Keeping in touch with old friends</li> 
<li>It is the technology of the future! </li> 

< /ul > 

<!-- named anchor --> 

<pxa name = eos' ></ax/p> 

<hl>My 3 Favorite <em>CEOs</emx/hl> 

<P> 


<!— internal hyperlink to features --> 

<a href = >Go to <em>Favorite Features</em> 

</ax/p> 

<ol> 

<li>Bill Gates</li> 

<li>Steve Jobs</li> 

<li>Michael Dell</li> 

< / ol > 

</body> 

</html> 


Fig. 27.6 Using internal hyperlinks to make pages more navigable (part 2 of 3). 
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Fig. 27.6 Using internal hyperlinks to make pages more navigable (part 3 of 3). 


Line 16 contains a named anchor (called features) for an internal hyperlink. To 
link to this type of anchor inside the same Web page, the href attribute of another anchor 
element includes the named anchor preceded with a pound sign (as in #f eatures). Lines 
63-64 contain a hyperlink with the anchor features as its target. Selecting this hyperlink 
in a Web browser scrolls the browser window to the features anchor at line 16. 

Look-and-Feel Observation 27.1 

Internal hyperlinks are useful in XHTML documents that contain large amounts ofinforma- 
tion. Internal links to various sections on the page makes it easierfor users to navigate the 
page. They do not have to scroll tofind a specific secti on. 

Although not demonstrated in this example, a hyperlink can specify an internal link in 
another document by specifying the document name followed by a pound sign and the 
named anchor, as in: 

href = "page.html#name" 

For example, to link to a named anchor called booklist in books .html, href is as- 
signed "books.htmlttbooklist". 



4 - 
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27.7 Creating and Using Image Maps 

In Chapter 26, we demonstrated how images can be used as hyperlinks to link to other re- 
sources on the Internet. In this section, we introduce another technique for image linking 
called image maps , which designate certain areas of an image (called hotspots) as links. 
Figure 27.7 introduces image maps and hotspots. 


1 

2 

3 

4 

5 

6 
7 


<?xml version = "1.0" ?> 
<!DOCTYPE html PUBLIC 


<!-- Fig. 27.7: picture.html --> 

<!-- Creating and Using Image Maps --> 


8 <html xmlns = "http: //www.w 

3.org/1999/xhtml "> 

9 

<head> 


10 

<title> 


11 

Python How to Program - Image Map 

12 

</title> 


13 

</head> 


14 



15 

<body> 


16 



17 

<P> 


18 



19 

< ! — the <map> tag defines an image map --> 

20 

<map id = "picture > 


21 



22 

<!-- shape = "rect 

" indicates a rectangular --> 

23 

<!-- area, with coordinates for the upper-left --> 

24 

<!-- and lower-right corners --> 

25 

<area href = "form 

.html" shape = "rect" 

26 

coords = "2,123 


27 

ait = "Go to th 

e feedback form' /> 

28 

<area href = "cont 

act.html " shape = " rect " 

29 

coords = "126,1 


30 

ait = "Go to th 

e contact page" /> 

31 

<area href = 

.ht 1" shape = "rect" 

32 

coords = "3,7,6 

1,25" ait = "Go to the homepage" 

33 

<area href = "link 

s. html" shape = "rect" 

34 

coords = "168,5 


35 

ait = "Go to th 

e links pac /> 

36 



37 

<!-- value "poly" 

creates a hotspot in the shape - 

38 

<!— of a polygon. 

defined by coords 

39 

<area shape = "pol 

y" ait = "E-mail the Deiteis" 

40 

coords = "162,2 


41 

href = "mailtos 

deitel@deitel.com" /> 

42 



43 

<!— shape = "circle" indicates a circular --> 

44 

<!-- area with the 

given center and radius --> 

45 

<area href = "mail 


Fig. 27.7 

Image with links anchored to an image map (part 1 of 2). 
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46 

shape = 

circle" coords = 



47 

ait = 


/> 


48 

</map> 




49 





50 

<!— <img src = 

... usemap = "#id" 

’> indicates that the 

51 

<!— specified 

image map is used 

with 

this image 

52 

<img src = "dei 

tel.gif" width = 


height = "144" 

53 

ait = "Deitr: 

.ogo" usemap = 


:ure" /> 

54 

</p> 




55 

</body> 




56 

</html> 







Fig. 27.7 Image with links anchored to an image map (part 2 of 2). 


Lines 2CM-8 define image maps using a map element. Attribute id (line 20) identifies 
the image map. If id is omitted, the map cannot be referenced by an image. We discuss 
how to reference an image map momentarily. Hotspots are defined with area elements (as 
shown on lines 25-27). Attribute href (line 25) specifies the link’s target (i.e., the 
resource to which to link). Attributes shape (line 25) and coords (line 26) specify the 
hotspot’s shape and coordinates, respectively. Attribute ait (line 27) provides alternate 
text for the link. 


Common Programming Error 27.5 



Not specifying an id attribute for a map element prevents an img element from using the 
map 's area elements to define hotspots. 


The markup on lines 25-27 creates a rectangular hotspot (shape = " rect ") for the 
coordinates specified in the coords attribute. A coordinate pair consists of two numbers 
representing the location of a point on the x-axis and the y-axis, respectively. The x-axis 
extends horizontally and the v-axis extends vertically from the upper-left corner of the 
image. Every point on an image has a unique x-y-coordinate. For rectangular hotspots, the 
required coordinates are those of the upper-left and lower-right corners of the rectangle. In 
this case, the upper-left corner of the rectangle is located at 2 on the x-axis and 123 on the 
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v-axis, annotated as (2, 123). The lower-right comer of the rectangle is at (54. 143). Coor- 
dinates are measured in pixels. 


Common Programming Error 27.6 



Overlapping coordinates ofan image map cause the browser to render thefirst hotspot it en- 
counters for the area. 


The map area (lines 39-41) assigns the shape attribute "poly" to create a hotspot 
in the shape of a polygon using the coordinates in attribute coords. These coordinates 
represent each vertex, or corner, of the polygon. The browser connects these points with 
lines to form the hotspot’s area. 

The map area (lines 45-47) assigns the shape attribute "circle" to create a cir¬ 
cular hotspot. In this case, the coords attribute specifies the circle’s center coordinates 
and the circle’s radius, in pixels. 

To use an image map with an img element, the img element’s usemap attribute is 
assigned the id of a map. Lines 52-53 reference the image map named "picture". The 
image map resides within the same document, so we use internal linking. 


27.8 meta Elements 

People use search engines to find useful Web sites. Search engines usually catalog sites by 
following links from page to page and saving Identification and classification information 
for each page. One way that search engines catalog pages is by reading the content in each 
page’s meta elements, which specify information about a document. 

Two important attributes of the meta element are name , which identifies the type of 
meta element and content, which provides the information search engines use to cat¬ 
alog pages. Figure 27.8 introduces the meta element. 

Lines 14-16 demonstrate a "keywords " meta element. The content attribute of 
such a meta element provides search engines with a list of words that describe a page. 
These words are compared with words in search requests. Thus, including meta elements 
and their content information exposes Web sites to a wider audience. 


1 <?xml version = ?> 

2 <! DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Striet //EN 

3 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-strict.dtd"> 

4 

5 <!-- Fig. 27.8: main.html --> 

6 <!-- <meta> tag --> 

7 

8 <html xmlns = "http://www.w3.org/1999/xhtml"> 

9 <head> 

<title>Python How to Program - Welcome</title> 

11 

12 <!-- <meta> tags provide search engines with --> 

13 <!— information used to catalog a site --> 

14 <meta name = "keywords" content = 'Web page, desi 

15 XHTML, tutorial, personal, help, index, form. 


Fig. 27.8 Using meta to provide keywords and a description (part 1 of 2), 
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16 contact, feedback, list, links, frame, deitel" /> 

17 

18 <meta name = 'descriptiori" content = "This Web site will 

19 help you learn the basies of XHTML and Web page desig: 

20 

21 /> 

22 

23 </head> 

24 

25 <body> 

26 

<hl>Welcome to Our Web Site!</hl> 

28 

<p>We have designed this site to teach about the wonders 

of <strongxem>XHTML</emx/strong> . <em>XHTML</em> is 

better equipped than <em>HTML :/em> to represent complex 
data on the Internet. <em> XHTML /em> takes advantage of 
XML ' s striet syntax to ensure well-formedness. Soon you 
will know about many of the great new features of 

35 <em>XHTML . < /emx /p> 

36 

37 <p Have Fun With the Site!</p> 

38 

39 </body> 

40 </html> 


Fig. 27.8 Using meta to provide keywords and a description (part 2 of 2), 


Lines 18-21 demonstrate a "description" meta element. The content 
attribute of such a meta element provides a three- to four-line description of a site, written 
in sentence form. Search engines also use this description to catalog your site and some- 
times display this information as part of the search results. 



meta elements are not visible to users and must be placed inside the head section ofyour 
XHTML document. Ifmeta elements are not placed in this section, they will not be read by 
search engines. 




27.9 frameset Element 

All of the Web pages we have presented in this book have the ability to link to other pages, 
but can display only one page at a time. Figure 27.9 uses frames, which allow the browser 
to display more than one XHTML document simultaneously, to display the documents in 
Fig. 27.8 and Fig. 27.10. 

Most of our prior examples conformed to the striet XHTML document type. This par- 
ticular example uses th e frameset document type—a special XHTML document type spe- 
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cifically for framesets. This new document type is specified in lines 2-3 and is required for 
documents that define framesets. 


1 <?xml version = ?> 

2 <! DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Frameset//EN" 

3 "http: //www.w3. org/TR/xhtmll/DTD/xhtmll-frameset . dtd" > 

4 

5 <!-- Fig. 27.9: index.html --> 

6 <!— XHTML Frames I —> 

7 

8 <html xmlns = "http://www.w3.org/1999/xhtml"> 

9 <head> 

<title>Python How to Program - Main</title> 

11 <meta name = content = 

12 XHTML, tutorial, personal, help, index, form, 

13 contact, feedback, list, links, frame, deitel" /> 

14 

15 <meta name = content = 

16 help you learn the basies of XHTML and Web page des 

17 

18 /> 

19 

20 </head> 

21 

22 <!— the <frameset> tag sets the frame dimensions --> 

23 <frameset cois = ”110, *"> 

24 

25 <!-- frame elements specify which pages --> 

26 <!-- are loaded into a given frame --> 

27 <frame name = ;ftf src = /> 

28 <frame name = iin" src = n.htm /> 

29 

30 <noframes> 

<p>This page uses frames, but your browser does not 

32 support them.</p> 

33 

<p>Please, <a href = >follow this link to 

35 browse our site without frames < /a> . </p> 

36 </noframes> 

37 

38 </frameset> 

39 </html> 


Fig. 27.9 Web document containing two frames—navigation and content (part 1 of 

2 ). 
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Left frame 

leftframe 


3 Python How to Program - Main - Microsoft Internet Explorer 

dald 

File Edit View 

Favorites Tools Help 

D 

J 4-Back ' >4 * 

^ ^Search [^Favorites (^History | p?) - 

a & s 

Address |^P] C : \Books\200 1 \py thonhtp 1 \py thonhtp 1 examples\ch27\index. html 

zl P ><3 ° 

1 - 3 

1- 



Header 

Examples 


Peedback 

Form 


e 


d 


Welcome to Our Web Site! 

We have designed this site to teach about the wonders of XHTML XHTML is 
better equipped than HTML to represent complex data on the Internet. 
XHTML takes advantage ofXMLDs striet syntaxto ensure well-formedness. 
Soon you will know about many of the great new features o£ XHTML. 

Have Fun With the Site! 


rn My Computer 


Right 

frame 



Fig. 27.9 Web document containing two frames—navigation and content (part 2 of 

2 ). 
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A document that defines a frameset normally consists of an html element that con- 
tains a head element and a frameset element. The <frameset> tag (line 23) informs 
the browser that a page contains frames. Attribute cois specifies the frameset’s column 
layout. The value of cois gives the width of each frame, either in pixels or as a percentage 
of the browser width. In this case, the attribute cois = " 110 , * " informs the browser that 
there are two vertical frames. The first frame extends 110 pixels from the left edge of the 
browser window and the second frame filis the remainder of the browser width (as indi- 
cated by the asterisk). Similarly, frameset attribute rows specifies the number of rows 
and the size of each row in a frameset. 

The documents that will be loaded into the frameset are specified with frame ele- 
ments (lines 27-28 in this example). Attribute src specifies the URL of the page to display 
in the frame. Each frame has name and src attributes. The first frame (which covers 110 
pixels on the left side of the frameset) is named leftframe and displays the page 
nav.html (Fig. 27.10). The second frame is named main and displays the page 
maln.html. 

Attribute name identifies a frame, enabling hyperlinks in a frameset to specify the 
target frame in which a linked document should display when the user clicks the link. 
For example 

<a href = "links itml" target = "main“> 

loads links.html in the frame whose name is "main". 

Not ali browsers support frames. XHTML provides the no frames element (lines 30- 
36) to enable XHTML document designers to specify alternate content for browsers that do 
not support frames. 

r_ni 

Some browsers do not support frames. Use the no frames element inside a frameset to 
direct users to a nonframed version ofyour site. 

Fig. 27.10 is the Web page displayed in the left frame of Fig. 27.9. This XHTML doc¬ 
ument provides the navigation buttons that, when clicked, determine which document is 
displayed in the right frame. 


■w- 


1 <?xml version = ?> 

2 <! DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" 

3 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-transitional.dtd"> 

4 

5 <!-- Fig. 27.10: nav.html --> 

6 <!— Using images as link anchors --> 

7 

8 <html xmlns = "http://wvjw.w3.org/1999/xhtml"> 

9 

10 <head> 

<title>Python How to Program - Navigation Bar 

12 </title> 

13 </head> 

14 


Fig. 27.10 XHTML document displayed in the left frame of Fig. 27,9 (part 1 of 2). 
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15 

<body> 



16 




17 

<P> 



18 

<a href = 

html target = 

"main" > 

19 

<img src = "bu 


" width = "6 

20 

height = "5 

0" ait = "Links 

Page" /> 

21 

</axbr /> 



22 




23 

<a href = "list.h 

tml" target = 

main' > 

24 

<img src = "bu 


width = '65 

25 

height = "5 

0" ait = "List 


26 

</axbr /> 



27 




28 

<a href = "contac 

t.html" target 

= "main"> 

29 

<img src = "bu 


pg" width = 

30 

height = "5 

0" ait = "Conta 

ct Page" /> 

31 

</axbr /> 



32 




33 

<a href = sader 

.html" target = 

"main" > 

34 

<img src = "bu 


width = 

35 

height = "5 

0" ait = "Heade 

r Page" /> 

36 

</axbr /> 



37 




38 

<a href = tablel 

.html " target = 

"main"> 

39 

<img src = "bu 


width = "6 

40 

height = "5 

0" ait = "Table 

Page" /> 

41 

</axbr /> 



42 




43 

<a href = "form.h 

target = 

main" > 

44 

<img src = "bu 


width = 

45 

height = "5 

0" ait = "Feedb 

ack Form" /> 

46 

</axbr /> 



47 

</p> 



48 




49 

< /body> 



50 

</html> 




Fig. 27.10 XHTML document displayed in the left frame of Fig. 27,9 (part 2 of 2). 

Line 27 (Fig. 27.9) displays the XHTML page in Fig. 27.10. Anchor attribute target 
(line 18 in Fig. 27.10) specifies that the linked documents are loaded in frame main (line 
28 in Fig. 27.9). A target can be set to a number of preset values: "_blank" loads the 
page into a new browser window, "_self " loads the page into the frame in which the 
anchor element appears and "_top" loads the page into the full browser window (i.e., 
removes the f rameset). 


4 - 


27.10 Nested framesets 

You can use the f rameset element to create more complex layouts in a Web page by 
nesting framesets, as in Fig. 27.11. The nested f rameset in this example displays the 
XHTML documents in Fig. 27.7, Fig. 27.8 and Fig. 27.10. 
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The outer frameset element (lines 23-41) defines two columns. The left frame extends 
over the first 110 pixels from the left edge of the browser and the right frame occupies the 
rest of the window’s width. The frame element on line 24 specifies that the document 
nav.html (Fig. 27.10) displays in the left column. 

Lines 28-31 define a nested frameset element for the second column of the outer 
frameset. This frameset defines two rows. The first row extends 175 pixels from the top 
of the browser window, as indicated by rows = "175, *". The second row occupies the 
remainder of the browser window ’ s height. The frame element at line 29 specifies that the 
first row of the nested frameset displays picture.html (Fig. 27.7). The frame ele¬ 
ment at line 30 specifies that the second row of the nested frameset displays 
maln.html (Fig. 27.9). 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 


<?xml version = '1.0" ?> 

<!DOCTYPE html PUBLIC "-/ /W3C//DTD XHTML 1.0 Frameset//EN 
"http://www.w3.org/TR/xhtmll/DTD/xhtmll-frameset.dtd" > 


<!-- Fig. 27.11: index2.html --> 

<!— XHTML Frames II —> 

<html xmlns = "http://www.w3.org/1999/xhtml"> 

<head> 

<title> Python How to Program - Main</title> 
cmeta name = "keywords" content = "Webpage, 


/> 


cmeta name 


content = 


/> 


</head> 

cframeset cois = "110,• > 

cframe name = "leftfrt src = "nav.hl /> 

<!-- nested framesets are used to change the --> 

<!-- formatting and layout of the frameset --> 
cframeset rows = "175, *"> 

cframe name = "picture" src = "picture.html" /> 

cframe name = "main" src = "main.html" /> 
c/frameset> 

cnoframes> 

cp>This page uses frames, but your browser does not 
support them.c/p> 

cp>Please, ca href = >follow this link to 

browse our site without framesc/a>. c/p> 


Fig. 27.11 Framed Web site with a nested frameset (part 1 of 2). 
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39 </noframes> 

40 

41 </frameset> 

42 </html> 



Left frame 

leftfram 


Right 
frame 
contains 
these two 
nested 


Fig. 27.11 Framed Web site with a nested frameset (part 2 of 2). 



Testing and Debugging Tip 27.2 

When using nested frameset elements, indent every level of <frame> tag. This practice 
makes the page clearer and easier to debug. 


In this chapter, we presented XHTML for marking up information in tables, creating 
forms for gathering user input, linking to sections within the same document, using 
<meta> tags and creating frames. In Chapter 28, we build upon the XHTML introduced 
in this chapter by discussing how to make Web pages more visually appealing with Cas- 
cading Style Sheets. 


4 - 


27.11 Internet and World Wide Web Resources 

courses.e-survey.net.au/xhtml/index.html 

The Web Page Design - XHTML site provides descriptions and examples for various XHTML fea- 
tures, such as links, tables, frames, forms, etc. Users can e-mail questions or comments to the Web 
Page Design support staff. 
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www.vbxml.com/xhtml/articles/xhtml_tables 

The VBXML.com Web site contains a tutorial on creating XHTML tables. 

www.webreference.com/xml/reference/xhtml.html 

This Web page contains a list of the frequently used XHTML tags, such as header tags, table tags, 

frame tags and form tags. It also provides a description of each tag. 

SUMMARY 

• XHTML tables mark up tabular data and are one of the most frequently used features in XHTML. 

• The table element defines an XHTML table. Attribute border specifies the table’s border 
width, in pixels. Tables without borders set this attribute to " 0 " . 

• Element summary summarizes the table’s contents and is used by speech de vices to make the ta¬ 
ble more accessible to users with visual impairments. 

• Element caption describe’s the table’s content. The text inside the <caption> tag is rendered 
above the table in most browsers. 

• A table can be split into three distinet sections: head (thead), body (tbody) and foot (tf oot). 
The head section contains information such as table tities and column headers. The table body con¬ 
tains the primary table data. The table foot contains information such as footnotes. 

• Element tr, or table row, defines individual table rows. Element th defines a header cell. Text in 
th elements usually is centered and displayed in bold by most browsers. This element can be 
present in any section of the table. 

• Data within a row are defined with td. or table data, elements. 

• Element colgroup groups and formats columns. Each coi element can format any number of 
columns (specified with the span attribute). 

• The document author has the ability to merge data cells with the rowspan and coi span at- 
tributes. The values assigned to these attributes specify the number of rows or columns occupied 
by the cell. These attributes can be placed inside any data-cell tag. 

• XHTML provides forms for collecting information from users. Forms contain visual components 
such as buttons that users click. Forms may also contain non-visual components, called hidden in- 
puts, which store data, such as e-mail addresses and XHTML document file names used for link- 
ing. 

• A form begins with the form element. Attribute method specifies how the form's data is sent to 
the Web server. 

• The " text " input inserts a text box into the form. Text boxes allow the user to input data. 

• The input element’s size attribute specifies the number of characters visible in the input el¬ 
ement. Optional attribute maxlength limits the number of characters input into a text box. 

• The " submit " input submits the data entered in the form to the Web server for processing. Most 
Web browsers create a button that submits the form data when clicked. The "reset" input al- 
lows a user to reset all form elements to their default values. 

• The textarea element inserts a multiline text box, called a text area, into a form. The number 
of rows in the text area is specified with the rows attribute and the number of columns (i.e., char¬ 
acters) is specified with the cois attribute. 

• The "password" input inserts a password box into a form. A password box allows users to enter 
sensitive information, such as credit card numbers and passwords, by “masking” the information 
input with another character. Asterisks are the masking character used for password boxes. The 
actual value input is sent to the Web server, not the asterisks that mask the input. 
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• The checkbox input allows the user to make a selection. When the checkbox is selected, a check 
mark appears in the check box. Otherwise, the checkbox is empty. Checkboxes can be used indi- 
vidually or in groups. Checkboxes that are part of the same group have the same name. 

• A radio button is similar in function to a checkbox, except that only one radio button in a group 
can be selected at any time. Ali radio buttons in a group have the same name attribute value and 
have different attribute values. 

• The select input provides a drop-down list of items. The name attribute identifies the drop- 
down list. The option element adds items to the drop-down list. The selected attribute, like 
the checked attribute for radio buttons and checkboxes, specifies which list item is displayed ini- 
tially. 

• Image maps designate certain sections of an image as links. These links are more properly called 
hotspots. 

• Image maps are defined with map elements. Attribute id identifies the image map. Hotspots are 
defined with the area element. Attribute href specifies the link’s target. Attributes shape and 
coords specify the hotspot’s shape and coordinates, respectively, and ait provides alternate 
text. 

• One way that search engines catalog pages is by reading the meta elements’s contents. Two im¬ 
portant attributes of the meta element are name, which identifies the type of meta element and 
content, which provides information a search engine uses to catalog a page. 

• Frames allow the browser to display more than one XHTML document simultaneously. The 
f rameset element informs the browser that the page contains frames. Not ali browsers support 
frames. XHTML provides the nof rames element to specify alternate content for browsers that 
do not support frames. 

• You can use the f rameset element to create more complex layouts in a Web page by nesting 

framesets. 


TERMINOLOGY 

action attribute 
area element 
border attribute 
browser request 

<caption> tag 

checkbox 

checked attribute 
coi element 
colgroup element 
cois attribute 
colspan attribute 
coords element 
form 

f orm element 
f rame element 
f rameset element 
header cell 

hidden input element 
hotspot 
href attribute 
image map 
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img clement 
input element 
internal hyperlink 
internal linking 
map element 
maxlength attribute 
meta element 
method attribute 
name attribute 
navigational frame 
nested f rameset element 
nested tag 

nof rames element 
password box 
"radio" (attribute value) 
rows attribute (textarea) 
rowspan attribute (tr) 
selected attribute 
size attribute (input) 
table element 
target = "_blank" 
target = "_self" 
target = "_top" 
tbody element 
td element 
textarea 

textarea element 
tfoot (table foot) element 
<thead>...</thead> 

tr (table row) element 
type attribute 
usemap attribute 
valign attribute (th) 
value attribute 
Web server 
XHTML form 
x-y-coordinate 

SELF-REVIEW EXERCISES 

27.1 State whether the following statements are true or false. If false, explain why. 

a) The width of ali data cells in a table must be the same. 

b) Framesets can be nested. 

c) You are limited to a maximum of 100 internal links per page. 

d) All browsers can render framesets. 

27.2 Fili in the blanks in each of the following statements: 

a) Assigning attribute type _in an input element inserts a button that, when 

clicked, clears the contents of the form. 

b) The layout of a frameset is set by including the _ attribute or the 

_attribute inside the <f rameset> tag. 
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c) The_element marks up a table row. 

d) _are used as masking characters in a password box. 

e) The common shapes used in image maps are_,_and_. 

27.3 Write XHTML markup to accomplish each of the following: 

a) Insert a framed Web page, with the first frame extending 300 pixels across the page from 
the left side. 

b) Insert a table with a border of 8. 

c) Indicate alternate content to a f rameset. 

d) Insert an image map in a page using deitel. gif as an image and map with name = 
"hello" as the image map, and set the ait text to “hello”. 

ANSWERS TO SELF-REVIEW EXERCISES 

27.1 a) False. You can specify the width of any column, either in pixels or as a percentage of the table 
width. b) True. c) False. You can have an unlimited number of internal links. d) False. Some browsers 
are unable to render a f rameset and must therefore rely on the information that you include inside 

the <noframes>...</noframes> tags. 

27.2 a) "reset". b) cois. rows. c) tr. d) asterisks. e) poly (polygons), circles, rect 
(rectangles). 

27.3 a) <frameset cois = >...</frameset> 

b) ctable border = >...</table> 

c) <noframes>...</noframes> 

d) <img src = ait = usemap = /> 

EXERCISES 

27.4 Categorize each of the following as an element or an attribute: 

a) width. 

b) td. 

c) th. 

d) frame. 

e) name. 

f) select. 

g) type. 

27.5 What will the f rameset produced by the following code look like? Assume that the pages 
referenced are blank with white backgrounds and that the dimensions of the screen are 800 by 600. 
Sketch the layout, approximating the dimensions. 

<frameset rows = "20%,*"> 

<frame src = "hello. hti 
<frameset cois = "1 
<frame src = "na 
<frame src = "de 
</frameset> 

</frameset> 

27.6 Write the XHTML markup to create a frame with a table of contents on the left side of the 
window, and have each entry in the table of contents use internal linking to scroll down the document 
frame to the appropriate subsection. 


name = "hello" /> 

"> 

:ml" name = "nav" /> 

..html" name = "deitel' /> 
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27.7 Create XHTML markup that produces the table shown in Fig. 27.12. Use <em> and 
<strong> tags as necessary. The image (camel. gif ) is included in the Chapter 27 examples di- 
rectory on the CD-ROM that accompanies this book. 



Fig. 27.12 XHTML table for Exercise 27.7. 

27.8 Write an XHTML document that produces the table shown in Fig. 27.13. 



Fig. 27.13 XHTML table for Exercise 27.8. 

27.9 A local university has asked you to create an XHTML document that allows potential stu- 
dents to provide feedback about their campus visits. Your XHTML document should contain a form 
with text boxes for names, addresses and e-mails. Provide check boxes that allow prospective stu- 
dents to indicate what they liked most about the campus. These check boxes should include: students, 
location, campus, atmosphere, dorm rooms and sports. Also, provide radio buttons that ask the pro¬ 
spective student how they became interested in the university. Options should include: friends, tele- 
vision. Internet and other. In addition, provide a text area for additional comments, a submit button 
and a reset button. 

27.10 Create an XHTML document titled “How to Get Good Grades.” Use <meta> tags to include 
a series of keywords that describe your document. 
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27.11 Create an XHTML document that displays a tic-tac-toe table with player X winning. Use 
<h2> to mark up both Xs and Os. Center the letters in each cell horizontally. Title the game using an 
<hl> tag. This title should span all three columns. Set the table border to one. 


(***DUMP FILE***) 


SELF-REVIEW EXERCISES 

27.1 State whether the following are true or false. If false, explain why. 

a) The width of all data cells in a table must be the same. 

ANS : False. You can specify the width of any column, either in pixels or as a percentage of 
the table width. 

b) Framesets can be nested. 

ANS : True. 

c) You are limited to a maximum of 100 internal links per page. 

ANS : False. You can have an unlimited number of internal links. 

d) All browsers can render framesets. 

ANS : False. Some browsers are unable to render a f rameset and must therefore rely on 
the information that you include inside the <nof rames >. ,.</nof rames > tags. 

27.2 Fili in the blanks in each of the following statements: 

a) The_attribute in an input element inserts a button that, when clicked, clears 

the contents of the form. 

ANS: type="reset". 

b) The spacing of a frameset is set by including the _ attribute or the 

_attribute inside the <f rameset> tag. 

ANS: cois. rows. 

c) The_element marks up a table row. 

ANS: tr. 

d) _are typically used as masking characters in a password box. 

ANS : Asterisks. 

e) The common shapes used in image maps are_,_and_. 

ANS: poly, circle, rect. 

27.3 Write XHTML markup to accomplish the following: 

a) Insert a framed Web page, with the first frame extending 300 pixels across the page from 
the left side. 

ANS: <frameset cois = "300, *">..,</frameset> 

b) Insert a table with a border of 8. 

ANS: <table border = "8">...</table> 

c) Indicate alternate content to a frameset. 

ANS: <noframes>...</noframes> 

d) Insert an image map in a page using deitel . gif as an image and map with name = 
"hello" as the image map, and set the ait text to “heilo’’. 

ANS: <img src = "deitel.gif" ait = "hello" usemap = "#hello" />. 


EXERCISES 

27.4 Categorize each of the following as an element or an attribute: 

a) width 

ANS : Attribute. 
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b) td 

ANS: Element. 

c) th 

ANS: Element. 

d) frame 
ANS: Element. 

e) name 

ANS: Attribute. 

f) select 
ANS: Element. 

g) type 

ANS: Attribute. 

27.5 What will the f rameset produced by the following code look like? Assume that the pages 
imported are blank with white backgrounds and that the dimensions of the screen are 800 by 600. 
Sketch the layout, approximating the dimensions. 

<frameset rows = "20%, *"> 

<frame src = "hello.html" name = "hei 
<frameset cois = "150, *"> 

<frame src = "nav.html" name = 

<frame src = "deitel.html" name 
</frameset> 

</frameset> 

ANS: 



/> 


/> 


/> 


27.6 Write the XHTML markup to create a frame with a table of contents on the left side of the 
window, and have each entry in the table of contents use internal linking to scroll down the document 
frame to the appropriate subsection 

ANS: 


1 <?xml version = ?> 

2 <! DOCTYPE html PUBLIC 
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3 

"http://www.w3.org/TR/xhtmll/DTD/xhtml 



dtd" > 

4 





5 

<!-- Exercise 27.6 Solution --> 




6 





7 

ehtml xmlns = "http://www.w3.org/1999/xht 

> 



8 

<head> 




9 

<title>Solution 27.6</title> 




10 

</head> 




11 

<frameset cois = "175, > 




12 

<frame name = debar" src = 



/> 

13 

<frame name = "main" src = "main 


/> 


14 

</frameset> 




15 

</html> 





i 

<?xml version = "1.0"?> 


2 

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1 


3 


-transitional.dtd" > 

4 



5 

<!-- Exercise 27.6 Solution: sidebar.html ■ 

--> 

6 



7 

<html xmlns = "http://www.w3.org/1999/xhtmi 

> 

8 

<head> 


9 

<title>Solution 27.6</title> 


10 

</head> 


11 

<body> 


12 

<ul> 


13 

<lixa href = "main.htmlttcamel 

target = !, main"> 

14 

Camel Picture</ax/li> 


15 

elixa href = "main.html#ticta< 


16 

target = >Tic Tac 

Toe :/ax/li> 

17 

elixa href = " ,in.html#table 


18 

target = >Table Examplee/a>e/li> 

19 

e/ul> 


20 

e/body> 


21 

e/html> 



1 

e?xml version = "1.0“?> 


2 

e!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1 


3 


-striet.dtd" > 

4 



5 

e!-- Exercise 27.6 Solution: main.html--> 


6 



7 

ehtml xmlns = "http://www.w3.org/1999/xhtmi 

> 

8 

ehead> 


9 

etitle>Solution 27.6e/title> 


10 

e/head> 


11 

ebody> 


12 

<P> 


13 

estrong> 



4 - 


14 

15 


<a name = 


>This is a picture of a 


camel: </ax/br> 
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16 

</strong> 


17 

<img src = "carnei*gi 

f" ait : 

18 

</p> 


19 

<p> 


20 

<strong> 


21 

<a name = "tictac 

toe"> 

22 

This is a tic 

tac toe 

23 

</strong> 


24 

</p> 


25 

<table border = > 


26 

27 

<!-- set all columns 

to be i 

28 

<colgroup> 


29 

<col align = "cen 

ter" /> 

30 

<col align = "cen 

ter' /> 

31 

<col align = "cen 

ter" /> 

32 

</colgroup> 



Chapter 27 


33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68 
69 


/> 


<!— top column will span across 3 cells --> 
<tr> 

<th colspan = "3 > 

<hl>This is the head of the 
Tic-Tac-Toe table 

</hl> 

</th> 

</tr> 

<!-- row one of the table --> 

<tr> 

<tdxh2>X</h2x/td> 

<tdxh2>0</h2x/td> 

<tdxh2>0</h2x/td> 

</tr> 

<!-- row two of the table --> 

<tr> 

<tdxh2>X</h2x/td> 

<tdxh2>X</h2x/td> 

<tdxh2>0</h2x/td> 

</tr> 

<!-- row three of the table --> 

<tr> 

<tdxh2>0</h2x/td> 

<tdxh2>0</h2x/td> 

<tdxh2>X</h2x/td> 

</tr> 

</table> 

<P> 

<strong> 

<a name = >This is an example of a 

table</a> 

</strong> 

</p> 



4 - 
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70 

71 

<table border = "1" width = 

"40V > 

72 

73 

<caption; Here is a small 

sample table</caption> 

74 

<thead> 


75 

<trxthxstrong>This 

is the table head</strong> 

76 

</thx/tr> 


77 

78 

</thead> 


79 

<tbody> 


80 

<tr> 


81 

<td align = "left" 

This is the body 

82 

</td> 


83 

</tr> 


84 

<tr> 


85 

<tdximg src = "de 

itel.gif" ait = "Deitel" /> 

86 

</td> 


87 

</tr> 


88 

</tbody> 


89 

</table> 


90 

</body> 


91 

</html> 
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27.7 Create XHTML markup that produces the table shown in Fig. 27.12. Use <em> and 
<strong> tags as necessary. The image (bug. jpg) is included in the Chapter 27 examples direc- 
tory on the CD-ROM that accompanies this book. 
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ANS: 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 


<?xml version = " 1 . 0 "?> 
<!DOCTYPE html PUBLIC 


<!-- Exercise 27.7 Solution --> 

<html xmlns = 'http://www.w3.org/1999/xhtml"> 

<head> 

<title>Solution 27.7</title> 

</head> 

<body> 

<table border = "1' width = "640" cellpadding = "7 > 

<tr> 

<tdxhl>Objectives</hl> 

<ul> 

<li>To be able to create tables with rows and 
columns of data.</li> 

<li>To be able to control the display and 
formatting of tables. </li> 

<li>To be able to create and use forms.</li> 
<li>To be able to create and use image maps 
to aid hyperlinking. </li> 

<li>To be able to use the <strong>f rameset 
</strong> element to display multiple 
Web Pages</li> 

</ul> 

<em>Yea, from the table of my memory I 1 11 wipe 
away ali trivial fond records. </emxbr /> 
William Shakespeare 

</td> 

<tdximg src = mel.g ait = picture" 

height = width = "200" /> 

</td> 

</tr> 

</table> 

</body> 

</html> 
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27.8 Write an XHTML document that produces the table shown in Fig. 27.13. 

ANS: 


1 <?xml version = ?> 

2 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN 

3 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-strict.dtd"> 

4 

5 <!-- Exercise 27.8 Solution --> 

6 

7 <html xmlns = "http://www.w3.org/1999/xhtml"> 

8 <head> 

<title>Solution 27.8</title> 

10 </head> 

11 <body> 

12 <h2>Table Example Page</h2> 

13 

14 <!— the table tag opens a new table --> 

15 <table border = width = "40V> 

16 


17 <!-- use the caption tag to summarize the table's --> 

18 <! — contents (this helps for the visually impaired --> 

<caption: Here is a small sample table</caption> 

20 

21 <!-- the <thead> is the first horizontal --> 

22 <!-- section. Use it to format the table header area. —> 

23 <!-- <th> inserts a header cell and displays bold text --> 

24 <thead> 

25 <tr> 
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26 

<th> 


27 

<strong>This is 

the table head< /strong> 

28 

</th> 


29 

</tr> 


30 

</thead> 


31 



32 

<!-- all of the main content goes in the <tbody> --> 

33 

<!-- use this tag to format the entire section --> 

34 

<!-- <td> inserts a data 

cell, with regular text --> 

35 

<tbody> 


36 

<trxtd align = 'left' 

>This is the body /tdx/tr> 

37 

</tbody> 


38 



39 

</table> 


40 

</body> 


41 

</html> 





4 - 


27.9 A local university has asked you to create an XHTML document that allows potential stu- 
dents to provide feedback about their campus visits. Your XHTML document should contain a form 
with text boxes for names, addresses and e-mails. Provide check boxes that allow prospective stu- 
dents to indicate what they liked most about the campus. These check boxes should include: students, 
location, campus, atmosphere, dorm rooms and sports. Also, provide radio buttons that ask the pro¬ 
spective student how they became interested in the university. Options should include: friends, tele- 
vision. Internet and other. In addition, provide a text area for additional comments, a submit button 
and a reset button. 

ANS: 


1 

<?xml version = "1,0"?> 



2 

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTM 



3 



lal .dtd"> 

4 




5 

<!-- Exercise 27.9 Solution --> 



6 




7 

<html xmlns = "http://www.w3.Org/1999/x 

html 1 > 


8 

<head> 



9 

<title>Solution 27.9</title> 
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12 

<hl>College Visit Feedback Form</hl> 

13 

<P> 


14 

Please fili out this 

form to let us know how your 

15 

visit was so that we 

can improve our facilities to 

16 

better suit you and your peers' needs. 

17 

</p> 


18 



19 

<form method = "post' action = > 

20 



21 

<P> 


22 

<input type = "hid 

den" name = "recipient" 

23 

value = "colleg 

e@. college.edu' /> 

24 

<input type = "hid 

den" name = "subject" 

25 

value = "Visit 

Feedback' /> 

26 

<input type = "hid 

den" name = "redirect" 

27 

value = index. 

html" /> 

28 

</p> 


29 



30 

<!-- insert a textbox 

to gather information about --> 

31 

<!-- the user 

--> 

32 



33 

<pxlabel>Full Name: 


34 

<input name = "fui 

lname" type = "text" 

35 

size = 40" /> 


36 

</labelx/p> 


37 



38 

<pxlabel > Addr es s 1: 


39 

<input name = "add 

ressl" type = "text" 

40 

size = "40" /> 


41 

</labelx/p> 


42 



43 

<pxlabel>Address2 : 


44 

<input name = "add 

ress2" type = "text" 

45 

size = "40" /> 


46 

</labelx/p> 


47 



48 

<pxlabel>Zip Code: 


49 

<input name = "zip 

type = "tex size = "10" /> 

50 

</labelx/p> 


51 



52 

<pxlabel>E-mail : 


53 

<input name = "ema 

it type = :ext" size = "25" /> 

54 

</labelx/p> 


55 



56 

<strongxem>Check off 

all of the characteristics that 

57 

you enjoyed about 

the college:</emx/strongxbr /> 

58 



59 

<!-- insert checkboxes for the user to check --> 

60 

<!-- off what he or she likes --> 

61 

<P> 


62 

<label>Campus 


63 

<input name = "lik 

es" type = "checkbox" 
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64 

value = "campus" 

/> 

65 

</label> 


66 



67 

<label>Students 


68 

<input nane = "like 

s" type = "checkbox" 

69 

value = "student 

s" /> 

70 

</label> 


71 



72 

<label>Location 


73 

<input name = "like 

type = "checkbox" 

74 

value = "locatio; 

/> 

75 

</label> 


76 

</p> 


77 



78 

<P> 


79 

<label>Atmosphere 


80 

<input name = "like 

s" type = "checkbox" 

81 

value = "atmosph 

ere" /> 

82 

</label> 


83 



84 

<label>Dorm Rooms 


85 

<input name = "like 

type = "checkbox" 

86 

value = "dormroo 

/> 

87 

</label> 


88 



89 

<1abe1> Sport s 


90 

<input name = "like 

type = "checkbox" 

91 

value = ports" 

/> 

92 

</label> 


93 

</p> 


94 

<strongxem>How did 

you become interested in 

95 

our college?</emx/strongxbr /> 

96 



97 

<!-- radio buttons, user can only select one 

98 



99 

<P> 


100 

<label>Friends 


101 

<input name = "inte 

rest" type = "radio" 

102 

value = friends 

checked = 'checked' /> 

103 

</label> 


104 



105 

<label>TV Advertisement 

106 

<input name = "inte 

rest" type = "radio" 

107 

value = /> 


108 

</label> 


109 



110 

< labe1> Internet 


111 

<input name = "inte 

rest" type = "radio" 

112 

value = "interne 

t" /> 

113 

</label> 


114 



115 

<label>Other 


116 

<input name = "inte 

rest" type = "radio" 

117 

value = "other" 

/> 


1251 
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118 

</label> 


119 

</p> 


120 

121 

<strongxem>Please give us any additional 

feedback 

122 

that you may have</em>< /strongxbr /> 


123 

124 

<!-- user can enter in multiple lines of 

--> 

125 

<!-- information in a textarea 

--> 

126 

127 

<P> 


128 

<label>Comments : 


129 

<textarea name = "comments" rows = 


130 

cois = "40"x/textarea> 


131 

</label> 


132 

</p> 


133 

<P> 


134 

<input type = "submit" value = "Submit 

/> 

135 

<input type = "reset" value = "Ciear" 

/> 

136 

</p> 


137 

</form> 


138 

</body> 


139 </html> 



© Copyright 1992-2002 by Deitel & Associates, Inc. AII Rights Reserved. 8/29/01 





























pythonhtpl_27.fm Page 1253 Wednesday, August 29, 2001 3:45 PM 



Chapter 27 



Introduction to XHTML: Part 2 


1253 





4 - 


27.10 Create an XHTML document titled “How to Get Good Grades.” Use <meta> tags to include 
a series of keywords that describe your document. 

ANS: 


1 <?xml version = ?> 

2 < !DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Striet//EN 

3 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-strict.atd"> 

4 

5 <!-- Exercise 27.10 Solution --> 

6 

7 <html xmlns = "http://www.w3.org/1999/xhtml"> 

8 <head> 

<title>Solution 27. 10</title> 
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10 

<meta name = "3 

teywords" content = "g 

11 


, work, homework, " /> 

12 

13 

cmeta name = 

iription" content = 

14 


: education" /> 

15 

</head> 


16 

<body> 


17 

<hl How to Get 

Good Grades</hl> 

18 

</body> 


19 

</html> 




27.11 Create an XHTML document that displays a tic-tac-toe table with player X winning. Use 
<h2> to mark up both Xs and Os. Center the letters in each cell horizontally. Title the game using an 
<hl> tag. This title should span all three columns. Set the table border to one. 

ANS: 


4 - 


1 

2 

3 

4 

5 

6 

7 

8 
9 


<?xml version = 1.0"?> 

<!DOCTYPE html PUBLIC 


<!-- Exercise 27.11 Solution --> 

<html xmlns = "http://www.w3.org/19S 

<head> 

<title>Solution 27 . ll</title> 


10 

</head> 


11 

12 

<body> 


13 

14 

<table border = > 


15 

<!-- set all columns 

to be i 

16 

<colgroup> 


17 

<col align = "cen 

ter 1 /> 

18 

<col align = "cen 

ter' /> 

19 

<col align = "cen 

ter 1 /> 

20 

21 

</colgroup> 


22 

<!-- top column will 

span a< 

23 

<tr> 


24 

<th colspan = "3" 

> 
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25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 


<hl>This is the head of the 
Tic-Tac-Toe table 

</hl> 

</th> 

</tr> 

<!-- row one of the table --> 

<tr> 

<tdxh2>X</h2x/td> 

< tdxh2 >0< /h2 x / td> 
<tdxh2>0</h2x/td> 

</tr> 

<!-- row two of the table --> 
<tr> 

< tdxh2 >X< /h2 x / td> 
<tdxh2>X</h2x/td> 
<tdxh2>0</h2x/td> 

</tr> 

<!-- row three of the table --> 
<tr> 

< tdxh2 >0< /h2 x / td> 
<tdxh2>0</h2x/td> 

< tdxh2 >X< /h2 x / td> 

</tr> 

</table> 

</body> 

</html> 
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[***Notes To Reviewers***] 

• This chapter will be sent for second-round review. 

• Please mark your comments in place on a paper copy of the chapter. 

• Please return only marked pages to Deitel & Associates, Inc. 

• Please do not send us e-mails with detailed, line-by-line comments; mark these directly on the pa¬ 
per pages. 

• Please feel free to send any lengthy additional comments by e-mail to cheryl. yaeger@dei- 
tel.net. 

• Please run ali the code examples. 

• Please check that we are using the correct programming idioms. 

• Please check that there are no inconsistencies, errors or omissions in the chapter discussions. 

• The manuscript is being copyedited by a professional copy editor in parallel with your reviews. 
That person will probably find most typos, spelling errors, grammatical errors, etc. 

• Please do not rewrite the manuscript. We are concemed rnostly with technical correctness and cor¬ 
rect use of idiom. We will not make significant adjustments to our writing style on a global scale. 
Please send us a short e-mail if you would like to make such a suggestion. 

• Please be constructive. This book will be published soon. We all want to publish the best possible 
book. 

• If you find something that is incorrect, please show us how to correct it. 

• Please read all the back matter including the exercises and any Solutions we provide. 

• Please review the index we provide with each chapter to be sure we have covered the topics you 
feel are important. 
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Cascading Style Sheets™ 

(CSS) 


Objectives 

• To take control of the appearance of a Web site by 
creating style sheets. 

• To use a style sheet to give all the pages of a Web site 
the same look and feel. 

• To use the class attribute to apply styles. 

• To specify the precise font, size, color and other 
properties of displayed text. 

• To specify element backgrounds and colors. 

• To understand the box model and how to control the 
margins, borders and padding. 

• To use style sheets to separate presentation from 
content. 

Fashions fade, style is eternal. 

Yves Saint Laurent 

A style does not go out of style as long as it adapts itself to 
its period. When there is an incompatibility between the style 
and a certain state ofmind, it is never the style that triumphs. 
Coco Chanel 

How liberating to work in the margins, outside a Central 
perception. 

Don DeLillo 

/Ve gradually risenfrom lower-class background to lower- 
class foreground. 

Marvin Cohen 
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Chapter 28 


Outline 

28.1 

Introduction 

28.2 

Inline Styles 

28.3 

Embedded Style Sheets 

28.4 

Conflicting Styles 

28.5 

Linking External Style Sheets 

28.6 

W3C CSS Validation Service 

28.7 

Positioning Elements 

28.8 

Backgrounds 

28.9 

Element Dimensions 

28.10 

Text Flow and the Box Model 

28.11 

User Style Sheets 

28.12 

Internet and World Wide Web Resources 

Summary • Terminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises 


28.1 Introduction 

In Chapters 26 and 27, we introduced the Extensible Markup Language (XHTML) for 
marking up information. In this chapter, we shift our focus from marking up information to 
formatting and presenting information using a W3C technology called Cascading Style 
Sheets (CSS) that allows document authors to specify the presentation of elements on a Web 
page (spacing, margins, etc.) separately from the structure of the document (section head- 
ers, body text, links, etc.). This separation of structure from presentation simplifies main- 
taining and modifying a document’s layout. 

28.2 inlineStyles 

A Web developer can declare document styles in many ways. In this section, we present 
inline styles that declare an individual elemenfs format using attribute style. Figure 28.1 
applies inline styles to p elements to alter their font sizes and colors. 


l 

<?xml version = "1,0"?> 



2 

< ! DOCTYPE html PUBLIC " - //W3C/ /DTD XHTM 



3 



. dtd rf > 

4 




5 

<!-- Fig. 28.1: inline.html --> 



6 

<!-- Using inline styles --> 



7 




8 

<html xmlns = "http://wvjw.w3.Org/1999/x 

html " > 


9 

<head> 



10 

<title>Inline Styles</title> 



11 

</head> 



12 





Fig. 28.1 Inline styles (part 1 of 2). 
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13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 


<body> 

<p>This text does not have any style applied to it.</p> 


<!-- The style attribute allows you to declare 
<!-- inline styles. Separate multiple styles 
<!-- with a semicolon. 

<p style = >This text has the 

<em>font-size</em> style applied to it, making 

</p> 


--> 

- - > 

--> 

it 20pt. 


<p style = "font-size: 20pt; color: #0000ff"> 

This text has the <em>f ont-size</em> and 
<em>color</em> styles applied to it, making it 
20pt. and blue.</p> 


</body> 
</html> 




4 - 


Fig. 28.1 Inline styles (part 2 of 2). 

The first inline style declaration appears in line 20. Attribute style specifies the style 
for an element. Each CSSproperty (the font-size property in this case) is followed by 
a colon and a value. On line 20, we declare the p element to have 20-point text size. Line 
21 uses element em to “emphasize” text, which most browsers do by making the font italic. 

Line 24 specifies the two properties, font-size and color , separated by a semi¬ 
colon. In this line, we set the text’s color to blue, using the hexadecimal code #0000f f. 
Color names may be used in place of hexadecimal codes, as we demonstrate in the next 
example. [Note: Inline styles override any other styles applied using the techniques we dis- 
cuss later in this chapter.] 

28.3 Embedded Style Sheets 

In this section, we present a second technique for using style sheets called embedded style 
sheets. Embedded style sheets enable a Web-page author to embed an entire CSS docu- 
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ment in an XHTML document’s head section. Figure 28.2 creates an embedded style 
sheet containing four styles. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 


<?xml version = " 1 . 0 ”?> 
<!DOCTYPE html PUBLIC 


<!-- Fig. 28.2: declared.html --> 

<!-- Declaring a style sheet in the header section. --> 

<html xmlns = "http://www.w3.org/1999/xhtml"> 

<head> 

<title>Style Sheets</title> 

<!-- this begins the style sheet section --> 
<style type = "text/css"> 


em 

{ 

background-color: 
color: } 

} 

hl 

{ 

font-family: rial, s 

} 

P 

{ 

font-size: } 


.special 

{ 

color: } 



</style> 

</head> 

<body> 

<!-- this class attribute applies the .blue style --> 

<hl class = >Deitel & Associates, Inc.</hl> 

<p> Deitel & Associates, Inc. is an internationally 
recognized corporate training and publishing organization 
specializing in programming languages. Internet/World 
Wide Web technology and object technology education. 
Deitel & Associates, Inc. is a member of the World Wide 
Web Consortium. The company provides courses on Java, 

C++, Visual Basic, C, Internet and World Wide Web 
programming, and Object Technology. </p> 

<hl>Clients</hl> 

<p class = > The company's clients include many 

<em>Fortune 1000 companies</em>, government agencies, 
branches of the military and business organizations. 
Through its publishing partnership with Prentice Hali, 
Deitel & Associates, Inc. publishes leading-edge 
programming textbooks, professional books, interactive 
CD-ROM-based multimedia Cyber Classrooms, satellite 
courses and World Wide Web courses. </p> 


Fig. 28.2 Declaring styles in the head of a document (part 1 of 2). 
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50 

51 </body> 

52 </html> 


Style Sheets - Microsoft Internet Explorer 


,lBl x| 

File Edit View Favorites Tools Help 


ha 

J Back ▼ ^ ' £ [$») fjJ} | ^Search pjy Favorites -^History § 

3 * 3 & R 


Address C : \Books\200 1 \pythonhtp 1 \pythonhtp 1 examples\ch28\dedared.html 




Deitel & Associates, Inc. 


Deitel & Associates, Inc. is an intemationally recognized corporate training and 
publishing organization specializing in programming languages, Intemet/World Wide Web 
technology and object technology education. Deitel & Associates, Inc. is a member of 
the World Wide Web Consortium. The company provides courses on Java, C++, Visual 
Basic, C, Internet and World Wide Web programming, and Object Technology. 

Ciients 

The company’s ciients include many govemment agencies, 

branches of the militaiy and business organizations. Through its publishing partnership 
with Prentice Hali, Deitel & Associates, Inc. publishes leading-edge programming 
textbooks, professional books, interactive CD-ROM-based multimedia Cyber 
Classrooms, satellite courses and World Wide Web courses. ^ 

Done ^ My Computer 

Fig. 28.2 Declaring styles in the head of a document (part 2 of 2). 

The style element (lines 13-24) defines the embedded style sheet. Styles placed in 
the head apply to matching elements in the entire document, not just to a single element. 
The type attribute specifies the Multipurpose Internet Mail Extension {MIME) type that 
describes a file’s content. CSS documents use the MIME type text/css. Other MIME 
types include image/gif (for GIF images) and text/javascript (for the JavaScript 
scripting language). 

The body of the style sheet (lines 15-22) declares the CSS rules for the style sheet. We 
declare rules for em (lines 15-16), hl (line 18) and p (line 20) elements. When the browser 
renders this document, it applies the properties defined in these rules to each element to 
which the rule applies. For example, the rule on lines 15-16 will be applied to ali em ele¬ 
ments. The body of each rule is enclosed in curly braces ({ and >). We declare a style class 
named special in line 22. Class declarations are preceded with a period and are applied 
to elements only of that class. We discuss how to apply a style class momentarily. 

CSS rules that embedded style sheets use the same syntax as inline styles; the property 
name is foliowed by a colon (s) and the value of that property. Multiple properties are sep- 
arated by semicolons (;). In this example, the color property specifies the color of text 
in an element line and property background-color specifies the background color of 
the element. 

The font-family property (line 18) specifies the name of the font to use. In this 
case, we use the arlal font. The second value. sans-serif, is a generic font family. 
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Not ali users have the same fonts installed on their computers, so Web-page authors often 
specify a comma-separated list of fonts to use for a particular style. The browser attempts 
to use the fonts in the order they appear in the list. Many Web-page authors end a font list 
with a generic font family name in case the other fonts are not installed on the user’s com¬ 
puter. In this example, if the arial font is not found on the system, the browser instead 
displays a generic sans-serif font such as helvetica or verdana. Other generic 
font families include serif (e.g., times new roman. Georgia), cursive (e.g., 
script), fantasy (e.g., critter) and monospace (e.g., courier, f ixedsys). 

The font-size property (line 20) specifies a 14-point font. Other possible measure- 
ments, in addition to pt (point), are introduced later in the chapter. Relative values — xx- 
small. x-small , small, smaller. medium , large , larger, x-large and xx- 
large also can be used. Generally, relative values for font-size are preferred over 
point sizes because an author does not know the specific measurements of the display for 
each client. For example, a user may wish to view a Web page on a handheld device with a 
small screen. Specifying an 18-point font size in a style sheet prevents such a user from 
seeing more than one or two characters at a time. However, if a relative font size is speci- 
fied, such as large or larger, the actual size is determined by the browser that displays 
the font. 

Line 30 uses attribute class in an hl element to apply a style class —in this case class 
special (declared as . special in the style sheet). When the browser renders the hl 
element, notice that the text appears on screen with both the properties of an hl element 
(arial or sans-serif font defined at line 18) and the properties of the. special 
style class applied (the color blue defined on line 22). 

The p element and the . special class style are applied to the text in lines 42-49. All 
styles applied to an element (the parent, or ancestor, element) also apply to that element’s 
nested elements ( descendant elements ). The em element inherits the style from the p element 
(namely, the 14-point font size in line 20), but retains its italic style. However, this property 
overrides the color property of the special class because the em element has its own 
color property. We discuss the rules for resolving these conflicts in the next section. 


28.4 Conflicting Styles 

Cascading style sheets are “cascading ” because styles may be defined by a user, an author 
or a user agent (e.g., a Web browser). Styles defined by authors take precedence over styles 
defined by the user, and styles defined by the user take precedence over styles defined by 
the user agent. Styles defined for parent and ancestor elements are also inherited by child 
and descendant elements. In this section, we discuss the rules for resolving conflicts be- 
tween styles defined for elements and styles inherited from parent and ancestor elements. 

Figure 28.2 presented an example of inheritance in which a child em element inherited 
the font-size property from its parent p element. However, in Fig. 28.2, the child em 
element had a color property that conflicted with (i.e., had a different value than) the 
color property of its parent p element. Properties defined for child and descendant ele¬ 
ments have a greater specificity than properties defined for parent and ancestor elements. 
According to the W3C CSS Recommendation, conflicts are resolved in favor of properties 
with a higher specificity. In other words, the styles defined for the child (or descendant) are 
more specific than the styles for that child’s parent (or ancestor) element; therefore, the 


4 ^ 
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chilcTs styles take precedence. Figure 28.3 illustrates examples of inheritance and speci- 
ficity. 


1 

2 

3 

4 

5 

6 

7 

8 
9 


<?xml version = "1,Q"?> 
<!DOCTYPE html PUBLIC 


<!-- Fig 28.3: advanced.html --> 
<!-- More advanced style sheets --> 

<html xmlns = "http://www.w3.org/19S 

<head> 


10 

<title>More Styles< /title> 


11 



12 

<style type = "text/css"> 


13 



14 

a.nodec { text-decoration: 

} 

15 



16 

a:hover { text-decoration: 


17 

color: ; 


18 

background-color: 


19 



20 

li em { color: ; 


21 

font-weight: bold 

} 

22 



23 

ul { margin-left: 

} 

24 



25 

ul ul { text-decoration: 


26 

margin-left: 15px 

} 

27 



28 

</style> 


29 

</head> 


30 



31 

<body> 


32 



33 

<hl; Shopping list for <em>Monday /em> 

34 



35 

<ul> 


36 

<li>Milk</li> 


37 

<li: Bread 


38 

<ul> 


39 

<li White bread /li> 


40 

<li Rye bread</li> 


41 

<li Whole wheat bread:/li> 

42 

< /ul > 


43 

</li> 


44 

<li>Rice</li> 


45 

<li>Potatoes</li> 


46 

<li>Pizza <em>with mushrooms /emx, 

47 

</ul> 


48 



49 

<pxa class = 'nodec" href = "hi 


: ig. 28.3 

Inheritance in style sheets (part 1 of 2). 
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Go to the Grocery store</ax/p> 

51 

52 </body> 

53 </html> 




Fig. 28.3 Inheritance in style sheets (part 2 of 2). 

Line 14 applies property text -decoration to ali a elements whose class attribute 
is set to nodec. The text-decoration property applies decorations to text within an 
element. By default, browsers underline the text marked up with an a element. Here, we set 
the text-decoration property to none to indicate that the browser should not underline 
hyperlinks. Other possible values for text-decoration include blink , overline. 
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line-through and under line. The .nodec appended to a is an extension of class 
styles; this style applies only to a elements that specify nodec as their class. 

Lines 16-18 specify a style for hover, which is a pseudoclass. Pseudoclasses give the 
author access to content not specifically declared in the document. The hover pseudoclass 
is activated dynamically when the user moves the mouse cursor over an element. 


Portability Tip 28.1 



To ensure that your style sheets work in various Web browsers, test your style sheets on ali 


client Web browsers that will render documents using your styles. 

Lines 20-21 declare a style for all em elements that are descendants of li elements. 
In the screen output of Fig. 28.3, notice that Monday (which line 33 contains in an em ele¬ 
ment) does not appear in bold red, because the em element is not in an li element. How- 
ever, the em element containing with mushrooms (line 46) is in an li element; 
therefore, it is formatted in bold red. 

The syntax for applying rules to multiple elements is similar. For example, to apply the 
rule in lines 20-21 to all li and em elements, you would separate the elements with 
commas, as follows: 

li, em { color: ; 


font-weight: 


} 


Lines 25-26 specify that all nested lists (ul elements that are descendants of ul ele¬ 
ments) be underlined and have a left-hand margin of 15 pixels. A pixel is a relative-length 
measurement —it varies in size, based on screen resolution. Other relative lengths are em 
(the so-called “M-height” of the font, which is usually set to the height of an uppercase M), 
ex (the so-called “x-height” of the font, which is usually set to the height of a lowercase x) 
and percentages (e.g., margin-left: 10%). To set an element to display text at 150% 
of its default text size, the author could use the syntax 

font-size: 1.5em 

Other units of measurement available in CSS are absolute-length measurements —i.e., units 
that do not vary in size based on the system. These units are in (inches), cm (centimeters), 
mm (millimeters), pt (points; 1 pt=l/72 in) and pc (picas—1 pc = 12 pt). 

- Good Programming Practice 28.1 



Whenever possible, use relative-length measurements. Ifyou use absolute-length measure- 
ments, your document may notbe readable on some client browsers (e.g.. wirelessphones). 

In Fig. 28.3, the entire list is indented because of the 75-pixel left-hand margin for top- 
level ul elements. However, the nested list is indented only 15 pixels more (not another 75 
pixels) because the child ul element’s margin-left property overrides the parent ul 
element’s margin-left property. 


28.5 Linking External Style Sheets 


Style sheets are a convenient way to create a document with a uniform theme. With external 
style sheets (i.e., separate documents that contain only CSS rules), Web-page authors can 
provide a uniform look and feel to an entire Web site. Different pages on a site can all use 
the same style sheet. Then, when changes to the style are required, the Web-page author 
needs to modify only a single CSS file to make style changes across the entire Web site. 
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Figure 28.4 presents an external style sheet and Fig. 28.5 contains an XFITML document 
that references the style sheet. 


1 

/* Fig. 

28.4: styles.css */ 


2 

3 

/* An external stylesheet */ 


4 

5 

a 

{ text-decoration: } 


6 

7 

a:hover 

{ text-decoration: 
color: ; 

7 

8 

9 


background-color: ccffc< 

} 

10 

11 

li em 

{ color: ; 

font-weight: 1 Ld; 


12 

13 


background-color: ttfffffJ 

} 

14 

15 

ul 

{ margin-left: } 


16 

ul ul 

{ text-decoration: 

7 


17 margin-left: } 


Fig. 28.4 External style sheet (styles. css). 


i 

<?xml version = "1.0"?> 


2 

< ! DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Striet/ 


3 


> 

4 



5 

<!-- Fig. 28.5: external.html --> 


6 

7 

<!-- Linking external style sheets --> 


8 

<html xmlns = "http://www.w3.org/1999/xhtml"> 


9 

<head> 


10 

<title>Linking External Style Sheets</title> 


11 

<link rei = "stylesheet" type = "text/css" 


12 

href = "styles.es© /> 


13 

</head> 


14 



15 

<body> 


16 



17 

<hl Shopping list for <em>Monday /em>:</hl> 


18 

<ul> 


19 

<li>Milk</li> 


20 

<li>Bread 


21 

<ul> 


22 

<li>White bread</li> 


23 

<li>Rye bread</li> 


24 

<li>Whole wheat bread</li> 


25 

< /ul> 


26 

</li> 


27 

<li>Rice</li> 


28 

<li>Potatoes</li> 



Fig. 28.5 Linking an external style sheet (part 1 of 2). 




4 ^ 
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29 

<li>Pizza 

<em>with mushrooms</emx/li> 

30 

</ul> 


31 



32 

<P> 


33 

<a href = "ht 

>Go to the Grocery store</a> 

34 

</p> 


35 



36 

</body> 


37 

</html> 








4 - 


Fig. 28.5 Linking an external style sheet (part 2 of 2). 

Lines 11-12 (Fig. 28.5) show a link element, which uses the rei attribute to specify 
a relationship between the current document and another document. In this case, we declare 
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the linked document to be a stylesheet for this document. The type attribute specifies 
the MIME type as text/css. The href attribute provides the URL for the document 
containing the style sheet. 



Style sheets are reusable. Creating them once and reusing them reduces programming ejfort. 



The link element can be placed only in the head element. The user can specify next and 
previous, which allows the user to link a whole series of documents. This feature allows 
browsers to print a large collection ofrelated documents at once. (In Internet Explorer , se- 
lect Print all linked documents in the Print... submenu ofthe File menu.) 


28.6 W3C CSS Validation Service 

The W3C provides a validation Service (j igsaw. w3 . org/css-validator) that val- 
idates external CSS documents to ensure that they conform to the W3C CSS Recommen- 
dation. Like XHTML validation, CSS validation ensures that style sheets have correct 
syntax. The validator provides the option of either entering the CSS document’s URL, past- 
ing the CSS document’s contents into a text area or uploading a CSS document from disk. 
Figure 28.6 illustrates uploading a CSS document from a disk. 
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Fig. 28.6 Validating a CSS document. 

Figure 28.7 shows the results of validating styles.css (Fig. 28.4), using the file 
upload feature available at 

jigsaw.w3.org/css-validator/val idator-upload.html 

To validate the document, click the Browse button to locate the file on your computer. Af- 
ter locating the file, click Submit this CSS file for validation to upload the file for val- 
idation. [Note: Like many W3C technologies, CSS is being developed in stages (or 
versions). The current version under development is Version 3.] 

28.7 Positioning Elements 

Prior to CSS, controlling the positioning of elements in an XHTML document was diffi- 
cult—the browser determined positioning. CSS introduces the position property and a 



















































pythonhtpl_28.fm Page 1270 Wednesday, August 29, 2001 4:08 PM 



1270 Cascading Style Sheets™ (CSS) 


Chapter 28 


capability called absolute positioning, which provides authors greater control over how 
document elements are displayed. Figure 28.8 demonstrates absolute positioning. 



Fig. 28.7 CSS validation results. (Courtesy of World Wide Web Consortium (W3C).) 


1 

<?xml version = "1.0" ?> 


2 

<!DOCTYPE html PUBLIC '-// 


3 


titmll/DTD/xhtmll-striet .dtd"> 

4 



5 

<!-- Fig 28.8: positioning 

.html --> 

6 

<!-- Absolute positioning 

of elements --> 

7 



8 

<html xmlns = "http://www. 

w3.org/1999/xhtml "> 

9 

<head> 


10 

<title>Absolute Positioning</title> 

11 

</head> 


12 



13 

<body> 


14 



15 

<pximg src = "i .gif 

" style = "position: absolute; 

16 



17 

ait = "First posi 

tioned image" /></p> 

18 

<p style = "position 


19 


>Positioned Text :/p> 

20 

<pximg src = "circi 

e.gif" style = "position: absolute; 

21 


" ait = 

22 


d image" /></p> 

23 



24 

</body> 



4 - 


Fig. 28.8 Positioning elements with CSS (part 1 of 2). 
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~25 </html> 



Fig. 28.8 Positioning elements with CSS (part 2 of 2). 

Lines 15-17 position the first img element (i.gif) on the page. Specifying an ele¬ 
menti position as absolute removes the element from the normal flow of elements 
on the page, instead positioning the element according to the distance from the top, lef t, 
right or bottom margins of its containing block (i.e., an element such as body or p). 
Here, we position the element to be 0 pixels away from both the top and lef t margins 
of the body element. 

The z-index attribute allows you to layer overlapping elements properly. Elements 
that have higher z-index values are displayed in front of elements with lower z-index 
values. In this example, i.gif has the lowest z-index (1), so it displays in the back- 
ground. The img element at lines 20-22 (circle.gif) has a z-index of 2, so it dis¬ 
plays in front of i.gif. The p element at lines 18-19 (Positioned Text) has a z- 
index of 3, so it displays in front of the other two. If you do not specify a z-index or if 
elements have the same z-index value, the elements are placed from background to fore- 
ground in the order they are encountered in the document. 

Absolute positioning is not the only way to specify page layout. Figure 28.9 demon- 
strates relative positioning in which elements are positioned relative to other elements. 

Setting the position property to relative, as in class super (lines 21-22), lays 
out the element on the page and offsets the element by the specified top, bottom, lef t or 
right values. Unlike absolute positioning, relative positioning keeps elements in the gen- 
eral flow of elements on the page, so positioning is relative to other elements in the flow. 


■w- 


1 <?xml version = ?> 

2 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Striet//EN 

3 "http://wv7w.w3.org/TR/xhtmll/DTD/xhtmll-strict.dtd"> 

4 

5 <!-- Fig. 28.9: positioning2.html --> 

6 <!-- Relative positioning of elements --> 


Fig. 28.9 Relative positioning of elements (part 1 of 3). 
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7 


8 

<html xmlns = "http / 

/www.w3 .org/1999/xhtml 11 > 

9 

<head> 


10 

11 

<title>Relative Positioning</title> 

12 

13 

<style type = 

'text/css"> 

14 

P 

{ font-size: ; 

15 

16 


font-family: verdana, arial, sans-serl 

17 

span 

{ color: ; 

18 


font-size: ; 

19 

20 


height: } 

21 

. super 

{ position: ; 

22 

23 


top: } 

24 

. sub 

{ position: ; 

25 

26 


bottom: } 

27 

.shiftleft 

{ position: ; 

28 

29 


left: } 

30 

.shiftright 

{ position: ; 

31 

32 


right: } 

33 

</style> 


34 

35 

</head> 


36 

37 

<body> 


38 

<p>The text at 

the end of this sentence 

39 

40 

<span class = 

>is in superscripte /span>.</p> 

41 

<p>The text at 

the end of this sentence 

42 

43 

<span class = 

>is in subscript</span> . </p> 

44 

<p>The text at 

the end of this sentence 

45 

46 

<span class = 

>is shifted lef t</span> . </p> 

47 

<p>The text at 

the end of this sentence 

48 

49 

<span class = 

>is shifted right</span> . </p> 

50 

</body> 


51 

</html> 



Fig. 28.9 Relative positioning of elements (part 2 of 3). 
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Fig. 28.9 Relative positioning of elements (part 3 of 3). 


We introduce the span element in line 39. Element span is a grouping element —it 
does not apply any inherent formatting to its contents. Its primary purpose is to apply CSS 
rules or id cittributes to a block of text. Element span is an inline-level element —it is dis- 
played inline with other text and with no line breaks. Lines 17-19 define the CSS rule for 
span. A similar element is the di v element, which also applies no inherent styles but is 
displayed on its own line, with margins above and below (a block-level element). 


Common Programming Error 28.1 



Because relative positioning keeps elements in theflow oftext in your documents, be carefu! 
to avoid unintentionally overlapping text. 


28.8 Backgrounds 

CSS also provides control over the element backgrounds. In previous examples, we intro- 
duced the background-color property. CSS also can add background images to doc¬ 
uments. Figure 28.10 adds a corporate logo to the bottom-right corner of the document. 
This logo stays fixed in the corner, even when the user scrolls up or down the screen. 


4 ^ 


1 <?xml version = ?> 

2 < l DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN 

3 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-strict.dtd"> 

4 

5 <!-- Fig. 28.10: background.html --> 

6 <I — Adding background images and indentation --> 

7 

8 <html xmlns = "http://www.w3 .org/1999/xhtml"> 

9 <head> 

10 <title>Background Images</title> 

11 

12 <style type = > 

13 

14 body { background-image: ; 


Fig. 28.10 Adding a background image with CSS (part 1 of 2). 
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15 

background-position: botto: 

M 

16 

background-repeat: no-repe 

r 

17 

background-attachment: 

; } 

18 



19 

p { font-size: ; 


20 

color: ; 


21 

text-indent: ; 


22 

font-family: ial, sans-s< 

; } 

23 



24 

.dark { font-weight: ; } 


25 



26 

</style> 


27 

</head> 


28 



29 

<body> 


30 



31 

<P> 


32 

This example uses the background-image, 

33 

background-position and background-attachment 

34 

styles to place the <span class = 

-Deitel 

35 

& Associates, Inc.</span> logo in the 

bottom. 

36 

right corner of the page. Notice how 

the logo 

37 

stays in the proper position when you 

resize the 

38 

browser window. 


39 

</p> 


40 



41 

</body> 


42 

</html> 




4 - 



Fig. 28.10 Adding a background image with CSS (part 2 of 2). 

The background-image property (line 14) specifies the image URL for the image 
logo.gif in the format uri ( fileLocation). The Web-page author can set the back- 
ground-color in case the image is not found. 
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The background-position property (line 15) places the image on the page. The 
keywords top, bottom. center, left and right are used individually or in combi- 
nation for vertical and horizontal positioning. Image can be positioned using lengths by 
specifying the horizontal length followed by the vertical length. For example, to position 
the image as vertically centered (positioned at 50% of the distance across the screen) and 
30 pixels from the top, use 

background-position: ; 

The background-repeat property (line 16) Controls the tiling of the background 
image. Tiling places multiple copies of the image next to each other to fili the background. 
Here, we set the tiling to no-repeat to display only one copy of the background image. 
The background-repeat property can be set to repeat (the default) to tile the image 
vertically and horizontally, repea t-xto tile the image only horizontally or repeat-y 
to tile the image only vertically. 

The final property setting, background-attachment: fixed (line 17), fixes the 
image in the position specified by background-position. Scrolling the browser 
window does not move the image from its position. The default value, scroll , moves the 
image as the user scrolls through the document. 

Line 21 indents the first line of text in the element by the specified amount, in this case 
lem. An author might use this property to create a Web page that reads more like a novel, 
in which the first line of every paragraph is indented. 

Line 24 uses the font-weight property to specify the “boldness” of text. Possible 
values are bold , normal (the default), bolder (bolder than bold text) and lighter 
(lighter than normal text). Boldness also can be specified with multiples of 100, from 100 
to 900 (e.g., 100, 200, ..., 900). Text specified as normal is equivalent to 400, and 
bold text is equivalent to 7 00 . However, many systems do not have fonts that scale this 
finely, so using the values from 100 to 900 might not display the desired effect. 

Another CSS property that formats text is the font-style property , which allows 
the developer to set text to none , italic or oblique (oblique defaults to italic 
if the system does not support oblique text). 

28.9 Element Dimensions 

In addition to positioning elements, CSS rules can specify the actual dimensions of each 
page element. Figure 28.11 demonstrates how to set the dimensions of elements. 


1 

<?xml version = 

'1.0"?> 


2 

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Striet/ 


3 




4 




5 

<!— Fig. 28.11: 

width.html --> 


6 

7 

8 

<!-- Setting box 

dimensions and aligning text --> 


chtml xmlns = "ht 

:tp://www.w3.org/1999/xhtml "> 


9 

<head> 



10 

<title>Box 

Dimensions</title> 



Fig. 28.11 Setting box dimensions and aligning text (part 1 of 2). 
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11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 


<style type = "text/css"> 

div { background-color: ; 

margin-bottom: } 

</style> 

</head> 

<body> 

<div style = Here is some 

text that goes in a box which is 
set to stretch across twenty percent 
of the width of the screen. </div> 

<div style = "width: 80%; text-align: center"> 

Here is some CENTERED text that goes in a box 
which is set to stretch across eighty percent of 
the width of the screen. </div> 

<div style = "width: 20%; height: 30%; overflow: 

This box is only twenty percent of 

the width and thirty percent of the height. 

What do we do if it overflows? Set the 
overflow property to scroll! </div> 

</body> 

</html> 


> 



Fig. 28.11 Setting box dimensions and aligning text (part 2 of 2). 
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The inline style in line 22 illustrates how to set the width of an element on screen; 
here, we indicate that the div element should occupy 20% of the screen width. Most ele- 
ments are left-aligned by default; however, this alignment can be altered to position the ele¬ 
ment elsewhere. The height of an element can be set similarly, using the height property. 
The height and width values also can be assigned relative and absolute lengths. For 
example 

width: 10em 

sets the element’s width to be equal to 10 times the font size. Line 27 sets text in the element 
to be center aligned; some other values for the text-align property are left and 
right. 

One problem with setting both dimensions of an element is that the content inside the 
element can exceed the set boundaries, in which case the element is simply made large 
enough for all the content to fit. However, in line 32, we set the overflow property to 
scroll, a setting that adds scrollbars if the text overflows the boundaries. 


28.10 Text Flow and the Box Model 


A browser normally places text and elements on screen in the order in which they appear 
in the XHTML document. However, as we have seen with absolute positioning, it is possi- 
ble to remove elements from the normal flow of text. Floating allows you to move an ele¬ 
ment to one side of the screen; other content in the document then flows around the floated 
element. In addition, each block-level element has a box drawn around it, known as the box 
model. The properties of this box can be adjusted to control the amount of padding inside 
the element and the margins outside the element (Fig. 28.12). 

In addition to text, whole elements can be floated to the left or right of content. This 
means that any nearby text wraps around the floated element. For example, in lines 30-32 
we float a div element to the right side of the screen. As you can see from the sample 
screen capture, the text from lines 34—41 flows cleanly to the left and underneath the div 
element. 

The second property on line 30, margin, specifies the distance between the edge of 
the element and any other element on the page. When the browser renders elements using 
the box model, the content of each element is surrounded by padding, a border and a 
margin (Fig. 6.13). 

Margins for individual sides of an element can be specified by using margin-top , 
margin-right , margin-lef t and margin-bottom. 

Lines 43-45 specify a div element that floats at the right side of the content. Property 
padding for the div element is set to . 5 em. Padding is the distance between the content 
inside an element and the element’s border. Like the margin, the padding can be set for 
each side of the box, with padding-top , padding-right , padding-left and 
padding-bottom. 

A portion of lines 54-55 show that you can interrupt the flow of text around a 
floated element by setting the ciear property to the same direction as that in which the 
element is floated—right or left. Setting the ciear property to all interrupts the 
flow on both sides of the document. 


4 ^ 
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1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 


<?xml version = "l.Q"?> 

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN 
"http://www.w3.org/TR/xhtmll/DTD/xhtmll-strict.dtd" > 


<!-- Fig. 28.12: floating.html --> 

<!-- Floating elements and element boxes --> 

<html xmlns = 'http://www.w3.org/1999/xhtml"> 

<head> 

<title>Flowing Text Around Floating Elements</title> 

<style type = ’text/css"> 

div { background-color: ; 

margin-bottom: ; 

font-size: ; 

width: } 

p { text-align: ; } 

</style> 

</head> 

<body> 

<div style = "text-align center"> 

Deitel & Associates, Inc.</div> 

<div style = "float: right; margin: .5em; 
text-align: right" > 

Corporate Training and Publishing</div> 

<p>Deitel & Associates, Inc. is an internationally 
recognized corporate training and publishing organization 
specializing in programming languages. Internet/World 
Wide Web technology and object technology education. 
Deitel & Associates, Inc. is a member of the World Wide 
Web Consortium. The company provides courses on Java, 

C++, Visual Basic, C, Internet and World Wide Web 
programming, and Object Technology. </p> 

<div style = "float: right; padding: .5em; 
text-align: right"> 

Leading-edge Programming Textbooks /div> 

<p: The company's clients include many Fortune 1000 
companies, government agencies, branches of the military 
and business organizations. Through its publishing 
partnership with Prentice Hali, Deitel & Associates, 

Inc. publishes leading-edge programming textbooks, 
professional books, interactive CD-ROM-based multimedia 


Fig. 28.12 Floating elements, aligning text and setting box dimensions (part 1 of 2). 
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Cyber Classrooms, satellite courses and World Wide Web 

54 courses. <span style = > Here is some 

55 unflowing text. Here is some unflowing text. </spanx/p> 

56 

57 </body> 

58 </html> 


3 Flowing Text Around Floating Elements - Microsoft Internet Explorer 

■ 


File Edit View Favorites Tools Help 



J Back * ^ [?1 faJ | ^Search |1Q Favorites -^History ^ § 

3 * 3 & SL 


Address C : \Books\200 1 \pythonhtp 1 \pythonhtp 1 examples\ch28\floating.html 


▼ | if^Go 


Deitel & Associates, Inc. 


Corporate Training and Publishing 


Deitel & Associates, Inc. is an intemationally 
recogmzed corporate training and publishing 
organization specializing in programming 

languages, Intemet/World Wide Web technology and object technology education. Deitel & Associates, Inc. is 
a member of the World Wide Web Consortium. The company provides courses on Java, C++, Visual Basic, C, 
Internet and World Wide Web programming, and Object Technology. 


Leading-edge Programming 
Textbooks 


The company's clients include many Fortune 1000 
companies, govemment agencies, branche s of the 
military and business orgamzations. Through its 
publishing partnership with Prentice Hali, Deitel & 

Associates, Inc. publishes leading-edge programming 

textbooks, professional books, Interactive CD-ROM-based multimedia Cyber Classrooms, satellite courses and 
World Wide Web courses. Here is some unflowing text. Here is some unflowing text. 


0] Done 


'10 My Computer 


zi 




Fig. 28.12 Floating elements, aligning text and setting box dimensions (part 2 of 2). 






Content 






Margin 

Border 

Padding 


Fig. 28.13 Box model for block-level elements. 

Another property of every block-level element on screen is the border, which lies 
between the padding space and the margin space and has numerous properties for adjusting 
its appearance as shown in Fig. 28.14. 

1 <?xml version = ?> 

Fig. 28.14 Applying borders to elements (part 1 of 3). 
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2 

<! DOCTYPE html PUBLIC 


Stri 


3 

" http : //www.w3 

.org/TR/xhtmll/ 

DTD/xhtmll-s 

trict 

odtd > 

4 






5 

< ! — Fig. 28.14: 

borders.html 

--> 



6 

<!-- Setting borders of an element --> 



7 






8 

chtml xmlns = "ht 



> 


9 

<head> 





10 

<title>Borders</title> 




11 






12 

<style type 

i = "text/css"> 




13 






14 

body 

{ background-color: 

} 


15 






16 

div 

{ text-align: c 

i 



17 


margin-bottom 

i 



18 


padding: 

} 



19 






20 

. thick 

{ border-width: 

} 



21 






22 

.medium 

{ border-width : 

} 



23 






24 

. thin 

{ border-width : 

} 



25 






26 

.groove 

{ border-style: 

} 



27 






28 

.inset 

{ border-style: 

} 



29 






30 

.outset 

{ border-style: 

} 



31 






32 

. red 

{ border-color : 

} 



33 






34 

. blue 

{ border-color: 

} 



35 






36 

</style> 





37 

</head> 





38 






39 

<body> 





40 






41 

<div class 

= "thick groove 

>This text 

has a 

border </div> 

42 

<div class 

= "medium groov 

>This text 

has 

a border </div> 

43 

<div class 

= "thin groove" 

>This text has a 

border < /div> 

44 






45 

<p class = 


>A thin red 

line 

... </p> 

46 

<p class = 


tset' > 



47 

And a thicker blue line</p> 



48 






49 

</body> 





50 

</html> 






Fig. 28.14 Applying borders to elements (part 2 of 3), 
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Fig. 28.14 Applying borders to elements (part 3 of 3). 

In this example, we set three properties— border-width, border-color and 
border-style. The border-width property may be set to any of the CSS lengths or 
to the predefined values of t hin, medium or thick. The border-color property sets 
the color. (This property has different meanings for different borders.) 

As with padding and margins, each of the border properties may be set for indi- 
vidual sides of the box (e.g., border-top-style or border-left-color). A 
developer can assign more than one class to an XHTML element by using the class 
attribute as shown in line 41. 

The border-styles are none, hidden, dotted, dashed, solid, double, 
groove, ridge, inset and outset. Borders groove and ridge have opposite 
effects, as do inset and outset. Figure 28.15 illustrates these border styles. 


4 - 


1 

<?xml version = "1.0"?> 



2 

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 



3 



dtd > 

4 




5 

<!-- Fig. 28.15: borders2.html --> 



6 

<!— Various border-styles --> 



7 




8 

<html xmlns = "http://www.w3.org/1999/xh 

tml > 


9 

<head> 



10 

<title>Borders </title> 



11 




12 

13 

<style type = ;ext/css"> 



14 

15 

body { background-color: 

i 



Fig. 28.15 Various border-styles (part 1 of2). 
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16 

div 

{ 

text-align: 

# 

17 




margin-bottom: 

/ 

18 




width: ; 


19 




position: relati 

s 

20 




left: ; 


21 




padding: > 


22 

</style> 




23 

</head> 





24 






25 

<body> 





26 






27 

<div 

style 

= 


>Solid border</div> 

28 

<div 

style 

= 


Double border</div> 

29 

<div 

style 

= 


> Groove border </div> 

30 

<div 

style 

= 


>Ridge border </div> 

31 

<div 

style 

= 


>Inset border</div> 

32 

<div 

style 

= 


.Outset border</div> 

33 






34 

</body> 





35 

</html> 







Fig. 28.15 Various border-styles (part 2 of 2). 

28.11 User Style Sheets 

Users can define their own user style sheets to format pages based on their preferences. For 
example, people with visual impairments may want to increase the page’s text size. A Web- 
page author needs to be careful because they may inadvertently override user preferences 
with defined styles. This section discusses possible conflicts between author styles and user 
styles. 

Figure 28.16 contains an author style. The font-size is set to 9pt for ali <p> tags 
that have class note applied to them. 
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User style sheets are external style sheets. Figure 28.17 shows a user style sheet that 
sets the body's font-size to 20pt, color to yellow and background-color 
to # 000080 . 

User style sheets are not linked to a document; rather, they are set in the browser’s 
options. To add a user style sheet in Internet Explorer 5.5, select Internet Options..., 
located in the Tools menu. In the Internet Options dialog (Fig. 28.18), select Accessi- 
bility .... Check the Format documents using my style sheet check box and type the 
location of the user style sheet. Internet Explorer 5.5 applies the user style sheet to any doc¬ 
ument it loads. 


1 <?xml version = ?> 

2 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Striet//EN" 

3 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-strict.dtd"> 

4 

5 <!— Fig. 28.16: user_absolute.html --> 

6 <!-- User styles --> 

7 

8 <html xmlns = "http://www.w3.org/1999/xhtml"> 

9 <head> 

10 <title>User Styles</title> 

11 

12 <style type = > 

13 

14 .note { font-size: } 

15 

16 </style> 

17 </head> 

18 

19 <body> 

20 

<p: Thanks for visiting my Web site. I hope you enjoy it. 
</P><P class = Please Note: This site will be 

moving soon. Please check periodically for updates.</p> 

24 

25 </body> 

26 </html> 


4 - 



Fig. 28.16 Modifying text size with the pt measurement. 
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1 /* Fig. 28.17: userstyles.css */ 

2 /* A user stylesheet */ 

3 

4 body { font-size: ; 

5 color: ; 

6 background-color: > 


Fig. 28.17 User style sheet. 


Formatting 

r~ Ignore colors specified on Web pages 
I - Ignore font styles specified on Web pages 
Ignore font sizes specified on Web pages 


-U*J 


General | Security | Content | Connections | Programs | Advanced | 


-LJxJ 


You can change which page to use for your home page. 
\ddress: 


User style sheet 

W Format documents using my style sheet 
Style sheet: 

13htp2\ch06examples\userstyles. css Browse.. 


Cancel 


ages you view on the Internet are stored in a special folder 
or quick viewing later, 


| http://www.deitel.com/ 
Use Current | Use Default 


Settings... | 


he History folder contains links to pages you've visited, for 
uick access to recently viewed pages. 

'ays to keep pages in history: | 20 ~H Ciear History | 


Accessibility. 


Apply 


Fig. 28.18 Adding a user style sheet in Internet Explorer 5.5. 


The Web page from Fig. 28.16 is displayed in Fig. 28.19, with the application of the 
user style sheet from Fig. 28.17. 



Fig. 28.19 Web page with userstyles applied. 
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In this example if users define their own font-size in user style sheets, the author 
styles have higher precedence and override the user styles. The 9pt font specified in the 
author style sheet overrides the 2 Opt font specified in the user style sheet. This small font 
may make pages difficult to read, especially for individuals with visual impairments. A 
developer can avoid this problem by using relative measurements (such as em or ex) 
instead of absolute measurements such as pt. Figure 28.20 changes the font-size prop- 
erty to use a relative measurement (line 14), which does not override the user style set in 
Fig. 28.17. Instead, the font size displayed is relative to that specified in the user style sheet. 
In this case, text enclosed in the <p> tag displays as 2Opt and <p> tags that have class 
note applied to them are displayed in 15pt (.75 times 2Opt). 


1 <?xml version = ?> 

2 <! DOCTYPE html PUBLIC "-/ /W3C//DTD XHTML 1.0 Strict//EN" 

3 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-strict.dtd"> 

4 

5 <!-- Fig. 28.20: user_relative.html --> 

6 <!— User styles --> 

7 

8 <html xmlns = "http://www.w3.org/1999/xhtml"> 

9 <head> 

10 <title>User Styles</title> 

11 

12 <style type = > 

13 

14 .note { font-size: } 

15 

16 </style> 

17 </head> 

18 

19 <body> 

20 

<p: Thanks for visiting my Web site. I hope you enjoy it. 
</pxp class = >Please Note: This site will be 

moving soon. Please check periodically for updates.</p> 

24 

25 </body> 

26 </html> 


4 - 



Fig. 28.20 Modifying text size with the em measurement. 
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Fig. 28.21 displays the Web page from Fig. 28.20 with the application of the user style 
sheet from Fig. 28.16. Notice that the second line of text displayed is larger than the same 
line of text in Fig. 28.19. 

28.12 Internet and World Wide Web Resources 

www.w3.org/TR/REC-CSS2 

The W3C Cascading Style Sheets, Level 2 specification contains a list of ali the CSS properties. The 
specification also provides helpful examples detailing the use of many of the properties. 

www.webreview.com/style 

This site has several charts of CSS properties, including a list containing which browsers support what 
attributes and to what extent. 

tech.irt.org/articles/css.htm 

This site contains articles dealing with CSS. 

msdn.microsoft.com/workshop/author/css/sitel014 .asp 

This site contains samples of some CSS features. 

www.web-weaving.net 

This site contains many CSS articles. 

SUMMARY 

• The inline style allows a developer to declare a style for an individual element by using the style 
attribute in that element’s opening XHTML tag. 

• Each CSS property is followed by a colon and the value of the attribute. 

• The color property sets text color. Color names and hexadecimal codes may be used as the value. 

• Styles that are placed in the <style> tag apply to the entire document. 

• style element attribute type specifies the MIME type (the specific encoding format) of the 
style sheet. Style sheets use text/css. 

• Each rule body begins and ends with a curly brace ({ and }). 

• Style class declarations are preceded by a period and are applied to elements of that specific class. 

• The CSS rules in a style sheet use the same format as inline styles: The property is followed by a 
colon (:) and the value of that property. Multiple properties are separated by semicolons (;). 

• The background-color attribute specifies the background color of the element. 



Fig. 28.21 Using relative measurements in author styles, 
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• The f ont-family attribute names a specific font that should be displayed. Generic font fami- 
lies allow authors to specify a type of font instead of a specific font, in case a browser does not 
support a specific font. The f ont-size property specifies the size used to render the font. 

• The class attribute applies a style class to an element. 

• Pseudoclasses provide the author access to content not specifically declared in the document. The 
hover pseudoclass is activated when the user moves the mouse cursor over an element. 

• The text-decoration property applies decorations to text within an element, such as 

underline. overline. line-through and blink. 


To apply rules to multiple elements, separate the elements with commas in the style sheet. 

A pixel is a relative-length measurement: It varies in size based on screen resolution. Other relative 
lengths are em, ex and percentages. 

The other units of measurement available in CSS are absolute-length measurements—i.e., units 
that do not vary in size. These units can be in (inches), cm (centimeters), mm (millimeters), pt 
(points; 1 pt=l/72 in) and pc (picas; 1 pc = 12 pt). 

External linking can create a uniform look for a Web site; separate pages can ali use the same 
styles. Modifying a single file makes changes to styles across an entire Web site. 

link's rei attribute specifies a relationship between two documents. 

The CSS position property allows absolute positioning, which provides greater control on 
where elements reside. Specifying an element’s position as absolute removes it from the 
normal flow of elements on the page and positions it according to distance from the top, lef t, 
right or bottom margins of its parent element. 

The z-index property allows a developer to layer overlapping elements. Elements that have 
higher z-index values are displayed in front of elements with lower z-index values. 

Unlike absolute positioning, relative positioning keeps elements in a general flow on the page and 
offsets them by the specified top, lef t, right or bottom values. 

Property background-image specifies the URL of the image, in the format uri (fileLoca- 
tion). The property background-position places the image on the page using the values 
top, bottom, center, lef t and right individually or in combination for vertical and hori- 
zontal positioning. You can also position by using lengths. 

The background-repeat property Controls the tiling of the background image. Setting the tiling 
to no-repeat displays one copy of the background image on screen. The background-re¬ 
peat property can be set to repeat (the default) to tile the image vertically and horizontally, to 
repeat-x to tile the image only horizontally or to repeat-y to tile the image only vertically. 
The property setting background-attachment: f ixed fixes the image in the position spec¬ 
ified by background-position. Scrolling the browser window does not move the image 
from its set position. The default value, scroll, moves the image as the user sciolis the window. 
The text-indent property indents the first line of text in the element by the specified amount. 
The f ont-weight property specifies the “boldness” of text. Values besides bold and normal 
(the default) are bolder (bolder than bold text) and lighter (lighter than normal text). The 
value also maybejustifiedusingmultiples of 100, from 100 to 900 (i.e., 100, 200, ..., 900). Text 
specified as normal is equivalent to 400, and bold text is equivalent to 700. 

The font-style property allows the developer to set text to none, italic or oblique 
(oblique will default to italic if the system does not have a separate font file for oblique text, 
which is normally the case). 

span is a generic grouping element; it does not apply any inherent formatting to its contents. Its 
main use is to apply styles or id attributes to a block of text. Element span is displayed inline 


4 ^ 
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(an inline element) with other text and with no line breaks. A similar element is the div element, 
which also applies no inherent styles, but is displayed on a separate line, with margins above and 
below (a block-level element). 

• The dimensions of elements on a page can be set with CSS by using the height and width prop- 
erties. 

• Text within an element can be centered using text-align: other values for the text- 
align property are lef t and right. 

• One problem with setting both dimensions of an element is that the content inside the element 
might sometimes exceed the set boundaries, in which case the element must be made large enough 
for ali the content to fit. However, a developer can set the overf low property to scroll; this 
setting adds scroll bars if the text overflows the boundaries set for it. 

• Browsers normally place text and elements on screen in the order in which they appear in the 
XHTML file. Elements can be removed from the normal flow of text. Floating allows you to move 
an element to one side of the screen; other content in the document will then flow around the float- 
ed element. 


• Each block-level element has a box drawn around it, known as the box model. The properties of 
this box are easily adjusted. 

• The margin property determines the distance between the element’s edge and any outside text. 


• CSS uses a box model to render elements on screen. The content of each element is surrounded by 
padding, a border and margins. 


Margins for individual sides of an element can be specified by using margin-top, margin- 
right, margin-lef t and margin-bottom. 


• The padding is the distance between the content inside an element and the edge of the element. 
Padding can be set for each side of the box by using padding-top, padding-right, pad¬ 
ding-lef t and padding-bottom. 


• A developer can interrupt the flow of text around a f loated element by setting the ciear prop¬ 
erty to the same direction in which the element is f loated—right or lef t. Setting the ciear 
property to all interrupts the flow on both sides of the document. 

• A property of every block-level element on screen is its border. The border lies between the pad¬ 
ding space and the margin space and has numerous properties with which to adjust its appearance. 

• The border-width property may be set to any of the CSS lengths or to the predefined values 

of thin. medium or thick. 


• The border-styles available are none, hidden, dotted. dashed. sol id, double, 
groove, ridge, inset and outset. 


• The border-color property sets the color used for the border. 

• The class attribute allows more than one class to be assigned to an XHTML element. 


TERMINOLOGY 

absolute positioning 
absolute-length measurement 
arial font 
background 

background-attachment 
background-color 
background-image 
background-position 
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Cascading Style Sheets (CSS) 

class attribute 

ciear property value 

cm (centimeter) 

colon (:) 

color 

CSS rule 

cur sive generic font family 
dashed border-style 
dotted border-style 
double border-style 
em (size of font) 
embedded style sheet 
ex (.r-height of font) 
floated element 
font-style property 
generic font family 
groove border style 
hidden border style 
href attribute 
in (inch) 
inline style 
inline-level element 
inset border-style 
large relative font size 
larger relative font size 
left 


line-through text decoration 
link element 

linking to an extemal style sheet 

margin 

margin-bottom property 
margin-left property 
margin-right property 
margin-top property 
medium relative border width 
medium relative font size 
mm (millimeter) 
monospace 
none border-style 
background-repeat 
blink 

block-level element 
border 

border-color 

border-style 

border-width 

box model 

outset border-style 
overf low property 
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overline text decoration 

padding 

parent element 

pc (pica) 

pseudoclass 

pt (point) 

rei attribute (link) 
relative positioning 
relative-length measurement 

repeat 

ridge border-style 

right 

sans-serif generic font family 

scroll 

separation of structure from content 
serlf generic font family 
small relative font size 
smaller relative font size 
sol id border-style 
span element 
style 

style attribute 
style class 

style in header section of the document 
text flow 

text/css MIME type 
text-align 

text-decoration property 
text-indent 
thick border width 
thin border width 
user style sheet 
x-large relative font size 
x-small relative font size 
xx-large relative font size 
xx-small relative font size 
z-index 


SELF-REVIEW EXERCISES 

28.1 Assume that the size of the base font on a system is 12 points. 

a) How big is 36-point font in ems? 

b) How big is 8-point font in ems? 

c) How big is 24-point font in picas? 

d) How big is 12-point font in inches? 

e) How big is 1-inch font in picas? 

28.2 Fili in the blanks in the foliowing statements: 

a) Using the_element allows authors to use external style sheets in their pages. 

b) To apply a CSS rule to more than one element at a time, separate the element names with 

a_. 

c) Pixels are a(n)_-length measurement unit. 
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d) The hover _is activated when the user moves the mouse cursor 

over the specified element. 

e) Setting the overf low property to_provides a mechanism for containing in¬ 

ner content without compromising specified box dimensions. 

f) While _ is a generic inline element that applies no inherent formatting, 

_is a generic block-level element that applies no inherent formatting. 

g) Setting the background-repeat property to_tiles the specified 

background-image only vertically. 

h) If you f loat an element, you can stop the flowing text by using property_. 

i) The_property allows you to indent the first line of text in an element. 

j) Three components of the box model are the_,_and_. 

ANSWERS TO SELF-REVIEW EXERCISES 

28.1 a) 3 ems. b) 0.75 ems. c) 2 picas, d) 1/6 inch. e) 6 picas. 

28.2 a) link. b) comma, c) relative, d) pseudoclass. e) scroll. f) span, div. g) y-repeat. 
h) ciear, i) text-indent. j) padding, border, margin. 

EXERCISES 

28.3 Write a CSS rule that makes all text 1.5 times larger than the base font of the system and col- 
ors the text red. 

28.4 Write a CSS rule that removes the underline frorn all links inside list items (li) and shifts 
them left by 3 ems. 

28.5 Write a CSS rule that places a background image halfway down the page, tiling it horizon- 
tally. The image should remain in place when the user scrolls up or down. 

28.6 Write a CSS rule that gives all hl and h2 elements a padding of 0.5 ems, a grooved border 
style and a margin of 0.5 ems. 

28.7 Write a CSS rule that changes the color of all elements containing attribute class = 
"greenMove" to green and shifts them down 25 pixels and right 15 pixels. 

28.8 Write an XHTML document that shows the results of a color survey. The document should 
contain a form with radio buttons that allows users to vote for their favorite color. One of the colors 
should be selected as a default. The document should also contain a table showing various colors and 
the corresponding percentage of votes for each color. (Each row should be displayed in the color to 
which it is referring.) Use attributes to format width, border and cell spacing for the table. 

28.9 Add an embedded style sheet to the XHTML document of Fig. 26.6. This style sheet should 
contain a rule that display s hl elements in blue. In addition, create a rule that displays all links in blue 
without underlining them. When the mouse hovers over a link, change the link’s background color to 
yellow. 

28.10 Modify the style sheet of Fig. 28.4 by changing a : hover to a : hver and margin- left 
to margin left. Validate the style sheet using the CSS Validator. What happens? 


(***DUMP FILE***) 


SELF-REVIEW EXERCISES 


28.1 Assume that the size of the base font on a system is 12 points. 
a) How big is 36-point font in ems? 
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ANS : 3 ems. 

b) How big is 8-point font in ems? 
ANS: 0.75 ems. 

c) How big is 24-point font in picas? 
ANS : 2 picas. 

d) How big is 12-point font in inches? 

ANS : 1/6 inch. 

e) How big is 1-inch font in picas? 
ANS : 6 picas. 


28.2 


Fili in the blanks in the folio wing statements: 

a) Using the_element allows you to use extemal style sheets in your pages. 

ANS: link. 

b) To apply a CSS rule to more than one element at a time, separate the element names with 

a_. 

ANS : comma. 

c) Pixels are a(n)_-length measurement unit. 

ANS : relative. 

d) The hover _is activated when the user moves the mouse cursor 

over the specified element. 

ANS : pseudoelement. 

e) Setting the overflow property to_provides a mechanism for containing in¬ 

ner content without compromising specified box dimensions. 

ANS: scroll. 

f) While _ is a generic inline element that applies no inherent formatting, 

_is a generic block-level element that applies no inherent formatting. 

ANS: span, div. 

g) Setting the background-repeat property to_tiles the specified 

background-image only vertically. 

ANS: y-repeat. 

h) If you f loat an element, you can stop the flowing text by using property_. 

ANS: ciear. 

i) The_property allows you to indent the first line of text in an element. 

ANS: text-indent. 

j) Three components of the box model are the_,_and_. 

ANS : padding, border, margin. 


EXERCISES 

28.3 Write a CSS rule that makes ali text 1.5 times larger than the base font of the system and col- 
ors it red. 

ANS: 


■w- 


1 <?xml version = ?> 

2 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Striet//EN 

3 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-strict.dtd"> 

4 

5 <!-- Exercise 28.3 Solution --> 

6 

7 <html xmlns = "http://www.w3.org/1999/xhtml"> 
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8 

<head> 


9 

<title>Solution 28. 

</title> 

10 

<style type = "text 

/css"> 

11 

body { font-size 

• r 

12 

color: #f: 

} 

13 

</style> 


14 

</head> 


15 



16 

<body> 


17 

<p>Testing red text 

that is 1.5 times the default 

18 

size</p> 


19 

</body> 


20 

</html> 




Testing red text that is 1.5 times the default font size 

_d 

ejDone | j |3 viy Computer 



28.4 Write a CSS rule that removes the underline from ali links inside list items (li) and shifts 
them left by 3 ems. 


ANS: 


1 

<?xml version = " 1 0 "?> 



2 

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 



3 



,dtd"> 

4 




5 

<!-- Exercise 28.4 Solution --> 



6 




7 

<html xmlns = "http://www.w3.org/1999/xh 

tml" > 


8 

<head> 



9 

<title>Solution 28.4</title> 



10 

<style type = text/css > 



11 

li a { text-decoration: 

> 


12 

li { position: ; 



13 

left: } 



14 

ol { position: absolute; 



15 

left: } 



16 

</style> 



17 

</head> 



18 




19 

<body> 



20 

<ol> 



21 

This list begins at the left of 

this text. 


22 

Notice the list items are left 

of this. 


23 

elixa href = - //www.deite 

1. com" > 
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http: //www.deitel.com< /ax/li> 

25 <lixa href = :p: //www.preahall. com > 

http: //www.prenhall.com </ax/li> 

27 <lixa href = 'http://vnjw.phptrinteractive.com"> 

28 http: //www.phptrinteractive.com</ax/li> 

29 </ol> 

30 </body> 

31 </html> 



28.5 Write a CSS rule that places a background image halfway down the page, tiling it horizon- 
tally. The image should remain in place when the user scrolls up or down. 


ANS: 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 


<?xml version = " 1 . 0 "?> 
<!DOCTYPE html PUBLIC 


<!-- Exercise 28.5 Solution --> 

chtml xmlns = "http://www.w3.org/1999/xhtml"> 

<head> 

<title>Solution 28.5</title> 

<style type = "text/css"> 
body { background-image: 

background-position: left cent 
background-repeat: ; 

background-attachment: } 

</style> 

</head> 

<body> 


<hl> . 

. </hl> 



<hl> - 

- </hl> 


<hl>++++++++++++++++++++++++++++++++++</hl> 
<hl> //////////////////////////////////< /hl> 
<hl> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! </hl> 

<hl>AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA</hl> 
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< h i>l IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII l</hi> 

28 </body> 

29 </html> 




28.6 Write a CSS rule that gives ali hl and h2 elements a padding of 0.5 ems, a grooved border 
style and a margin of 0.5 ems. 

ANS: 


1 <?xml version = ?> 
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1 <!DOCTYPE html PUBLIC '-//W3C//DTD XHTML 1.0 Striet//EN 

3 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-strict.dtd"> 

4 

5 <!-- Exercise 6.6 Solution --> 

6 

7 <html xmlns = "http://www.w3.org/1999/xhtml"> 

8 <head> 

<title>Solution 6.6</title> 


10 

<style type 

= "text/css"> 

11 

hl, h2 

{ 

padding: ;m; 

12 



border-style: gr< 

13 



margin: > 

14 

</style> 



15 

</head> 



16 




17 

<body> 



18 

<hl>This 

is 

an Hl header</hl: 

19 

<h2 >This 

is 

an H2 header</h2: 

20 

</body> 



21 

</html> 





4 - 


28.7 Write a CSS rule that changes the color of all elements with attribute class = "green- 
Move" to green and shifts them down 25 pixels and right 15 pixels. 

ANS: 


1 

<?xml version = " 1 . 0 "?> 



2 

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 



3 



.dtd" > 

4 




5 

<!-- Exercise 28.7 Solution --> 



6 




7 

<html xmlns = "http://www.w3.org/1999/xht 

;ml > 


8 

<head> 



9 

<title>Solution 28.7</title> 



10 

<style type = "text/css"> 



11 

.greenMove { color: ; 
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12 


position: ; 

13 


top: ; 

14 


left: } 

15 

</style> 


16 

</head> 


17 



18 

<body> 


19 

<hl>Normal text 


20 

<span class = 

Text with class 

21 

greenMove 


22 

</span> 


23 

</hl> 


24 

</body> 


25 

</html> 





28.8 Write an XHTML document showing the results of a survey of people’s favorite color. The 
document should contain a form with radio buttons that allows users to vote for their favorite color. 
One of the colors should be selected as a default. The document should also contain a table showing 
various colors and the corresponding percentage of votes for each color. (Each row should be dis- 
played in the color to which it is referring.) Use attributes to format width, border and cell spacing for 
the table. Validate the document against an appropriate XHTML DTD. 

ANS: 


4 ^ 


1 

<?xml version = "1 0 "?> 


2 

< ! DOCTYPE html PUBLIC " - //W3C//DTD XHTML 


3 


11-strict.dtd"> 

4 



5 

A 

<!-- Exercise 28.8 Solution --> 


7 

<html xmlns = "http://www.w3.org/1999/xh 

tml > 

8 

<head> 


9 

<title>Solution 28.8</title> 


10 

<style type = ”text/css"> 


11 

.blue { background-color: 

OOff } 

12 

.red { background-color: 

0000 } 

13 

.yellow { background-color: 

ffOO } 

14 

.green { background-color: 

ffOO } 

15 

.orange { background-color: 

9900 } 

16 

.purple { background-color: 

0099 } 
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17 

.pink { background-color: 

#ff0099 } 

18 

p { font-size: ; ?t; 

text-decoration: 

19 

</style> 


20 

</head> 


21 

<body> 


22 



23 

<table border = "0" cellspacing = 5"> 

24 

<tr> 


25 

<td rowspan = "9"> 


26 

<hl>Favorite Color Survey</hl> 

27 

<form method = "post" 

action = ""> 

28 

<P> 


29 

<label>Blue 


30 

<input name 

= "colo: type = 

31 

checked = 

"checked" value 

32 

</label> 


33 

</p> 


34 

<P> 


35 

<label> Red 


36 

<input name = 

color" type = 

37 

value = "Red 

/> 

38 

</label> 


39 

</p> 


40 

<pxlabel>Yellow 


41 

<input name = 

type = 

42 

value = "Yel 

low" /> 

43 

</label> 


44 

</p> 


45 

<P> 


46 

<labe1 >6reen 


47 

cinput name = " 

color" type = 

48 

value = 

en" /> 

49 

</label> 


50 

</p> 


51 

<P> 


52 

<label>Orange 


53 

<input name = " 

type = 

54 

value = 

nge" /> 

55 

</label> 


56 

</p> 


57 

<P> 


58 

<label> Purple 


59 

<input name = " 

type = 

60 

value = 

ple" /> 

61 

</label> 


62 

</p> 


63 

<P> 


64 

<label>Pink 


65 

<input name = 

type = 

66 

value = "Pin 

.k" /> 

67 

</label> 


68 

</p> 


69 

<P> 


70 

<input type = " 

submit" value = 
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71 

72 

73 

74 

75 

76 

77 

78 

79 

80 
81 
82 

83 

84 

85 

86 

87 

88 

89 

90 

91 

92 

93 

94 

95 

96 

97 

98 

99 

100 
101 
102 

103 

104 

105 

106 

107 

108 

109 

110 
111 
112 


"Submit" /> 

<input type = value = /> 

</p> 

</form> 

</td> 

<tdxstrong>Color Resuit </strongx/td> 

</tr> 

<tr> 

<td class = bl' x/td> 

<tdxp>30%</px/td> 

</tr> 

<tr> 

<td class = "red 1 > 

</td> 

<tdxp>13%</px/td> 

</tr> 

<tr> 

<td class = yellow x/td> 

<tdxp>9%</px/td> 

</tr> 

<tr> 

<td class = "gr x/td> 

<tdxp> 12%< /px / td> 

</tr> 

<tr> 

<td class = "orr x/td> 

<tdxp>12%</px/td> 

</tr> 

<tr> 

<td class = "purple x/td> 

<tdxp>7%</px/td> 

</tr> 

<tr> 

<td class = x/td> 

<tdxp> 17%< /px / td> 

</tr> 

<tr> 

<tdx/td> 

</tr> 

</table> 

</body> 

</html> 
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3 Solution 28.8 - Microsoft Internet Explorer 


JSlxj 


File Edit View Favorites Tools Help 


■Back ▼ ^ 4} ^Search P*! Favorites ^History | 1^» ^ j 


C: \Books\200 1 \pythonhtp 1 \pythonhtp 1 solutions\ch28\ex28 08. html 3 


Favorite Color Survey coiorResuits 

Blue c 
Red r 
Yellow r 
Green c 
Orange c 
Purple r 
Pink r 

Submit I Ciear I 



£] Done 


My Computer 


zl 


28.9 Add an embedded style sheet to the XHTML document of Fig. 26.4. This style sheet should 
contain a rule that displays hl elements in blue. In addition, create a rule that displays ali links in blue 
without underlining them. When the mouse hovers over a link, change the link’s background color to 
yellow. 

ANS: 




1 

<?xml version = "1 

. 0 "?> 

2 

<1DOCTYPE html PUBLIC 

3 



4 



5 

<!— Exercise 28.9 

: solution --> 

6 



7 

chtml xmlns = 


8 

<head> 


9 

<title>Solution 28.9</title> 

10 

<style type 

= "text/css"> 

11 

hl { 

color: } 

12 

.dark { 

font-weight : 

13 

a { 

text-decoration: 

14 

a:hover { 

background-color 

15 

</style> 


16 

</head> 


17 



18 

<body> 


19 
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20 

21 

<hl Here are my 

favorite sites</hl> 


22 

<pxspan class = 

>Click on a 

name to go to 

23 

24 

that page.</spanx/p> 


25 

26 

<pxa href = "ht 


>Deitel</ax/p> 

27 

28 
29 

<pxa href = "ht 
Hall</ax/p> 


>Prentice 

30 

31 

<pxa href = "ht 


>Yahoo! </ax/p> 

32 

33 

34 

35 

<pxa href = "ht 

</body> 

</html> 


>USA Today</ax/p> 




4 - 


28.10 Modify the style sheet of Fig. 28.4 by changing a:hover to a :hver and margin-lef t 
to margin lef t. Validate the style sheet using the CSS Validator. What happens? 

ANS: 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 


/* Exercise 28.10: modified Fig 28.4 styles.css */ 
/* An external stylesheet */ 

a { text-decoration: } 

a:hver { text-decoration: le; 

color: ; 

background-color: } 

li em { color: ; 

font-weight: ; 
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12 

13 


background-color: 

} 

14 

15 

ul 

{ margin left: 

} 

16 

ul ul 

{ text-decoration: 

; 

17 


margin left: 5cm 

} 
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[***Notes To Reviewers***] 


• Please mark your comments in place on a paper copy of the chapter. 

• Please return only marked pages to Deitel & Associates, Inc. 

• Please do not send us e-mails with detailed, line-by-line comments; mark these directly on the pa¬ 
per pages. 

• Please feel free to send any lengthy additional comments by e-mail to cheryl. yaeger@dei- 
tel.net. 

• Please run all the code examples. 

• Please check that we are using the correct programming idioms. 

• Please check that there are no inconsistencies, errors or omissions in the chapter discussions. 

• The manuscript is being copyedited by a professional copy editor in parallel with your reviews. 
That person will probably find most typos, spelling errors, grammatical errors, etc. 

• Please do not rewrite the manuscript. We are concemed mostly with technical correctness and cor¬ 
rect use of idiom. We will not make significant adjustments to our writing style on a global scale. 
Please send us a short e-mail if you would like to make such a suggestion. 

• Please be constructive. This book will be published soon. We all want to publish the best possible 
book. 


If you find something that is incorrect, please show us how to correct it. 

Please read all the back matter including the exercises and any Solutions we provide. 

Please review the index we provide with each chapter to be sure we have covered the topics you 
feel are important. 
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E 
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1270 
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1283 
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extension of class styles 1265 
external linking 1265 
external style sheet 1265 
External style sheet 

(styles. css) 1266 
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1277 

font - fami ly property 1261 
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1275 

Format documents using my 
style sheet check box 1283 

G 

generic font family 1261 
Georgia font 1262 
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property) 1281 
grouping element 1273 

H 

head element 1261 
height property 1277 
Helvetica font 1262 
hidden value (border- style 

property) 1281 
horizontal positioning 1275 

I 

id attribute 1273 
image centered vertically 1275 
image/gif 1261 
img element 1271 
in (inches) 1265 
inherit a style 1262 
inheritance 1262 
Inheritance in style sheets 1263 
inline-level element 1273 
inline style 1258, 1261 
inline styles 1258 
inline styles override any other 
styles 1259 

inset value (border-style 

property) 1281 
italic 1275 


J 
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idator 1268 

L 

large relative font size 1262 
larger relative font size 1262 
layer overlapping elements 1271 
left margin 1271, 1275, 1277 
lighter value 1275 
line-through value 1265 
link element 1267 
Linking an extemal style sheet 
1266 

linking extemal style sheets 1265 

M 

margin 1277 

margin-bottom attribute 
(div) 1277 

margin-left attribute (div) 
1277 

margin-lef t property 1265 
margin property 1277 

margin-right attribute (div) 
1277 

margin space 1279 

margin-top attribute (div) 
1277 
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element 1277 

medium relative font size 1262 
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MIME (Multipurpose Internet 
Mail Extension) 1261 
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measurement 1283, 1285 
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1265 

Multipurpose Internet Mail 
Extension (MIME) 1261 

N 

nested list 1265 
next 1268 

no-repeat property 1275 
none value 1275 
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property) 1281 


normal value 1275 

O 

oblique value 1275 
outset value (border-style 

property) 1281 
overflow boundaries 1277 
overflow property 1277 
overlapping text 1273 
over line value 1264 

P 

padding-bottom value 1277 
padding-left value 1277 
padding-right value 1277 
padding space 1279 
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position property 1269 
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1270 
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R 

relative length 1277 
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1271 
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V 
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w 
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Web page with user styles enabled 
1284 
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1277 


X 

x-large relative font size 1262 
x-small relative font size 1262 
xx-large relative font size 1262 
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Z 

z-index 1271 


U 

underline 1265 
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uri(fileLocation) 1274 
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User style sheet 1284 
user style sheet 1282, 1285 
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Objectives 

• To understand PHP data types, operators, arrays and 
control structures. 

• To understand string processing and regular 
expressions in PHP 

• To construet programs that process form data. 

• To read and write client data using cookies. 

• To construet programs that interact with MySQL 
databases. 


Conversion for me was not a Damascus Road experience. I 
slowly moved into an intellectual acceptance ofwhat my 
intuition had always known. 

Madeleine L’Engle 

Be careful when reading health books; you may die ofa 
misprint. 

Mark Twain 

Reckeners without their host must recken twice. 

John Heywood 

There was a door to which Ifound no key; There was the veil 
through which I might not see. 

Omar Khayyam 



Under 

Constructi on 
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[***Note S to Reviewers***] 

• Our first topic choice for this chapter was PHP. We then decided to change the topic to PSP (since 
it is more Python specific); however, due to the fact that PSP is in poor condition, we decided to 
revert back to PHP. We stili prefer to do PSP, so any information you can provide would be help- 
ful. Websites? Documentation? We were unable to get PSP 1.3 to run with Tomcat or JRun. Then, 
we were unable to download PSP 1.3. 

• Example 29.19 is not working (it is unable to open the Products database). We are currently work- 
ing to resolve this issue. 

• Please mark your comments in place on a paper copy of the chapter. 

• Please retum only marked pages to Deitel & Associates, Inc. 

• Please do not send e-mails with detailed, line-by-line comments; mark these directly on the paper 
pages. 

• Please feel free to send any lengthy additional comments by e-mail to 

rashmi .jayaprakash@deitel.net and ben.wiedermann@deitel.net. 

• Please run ali the code examples. 

• Please check that we are using the correct programming idioms. 

• Please check that there are no inconsistencies, errors or omissions in the chapter discussions. 

• The manuscript is being copy edited by a professional copy editor in parallel with your reviews. 
That person will probably find most typos, spelling errors, grammatical errors, etc. 

• Please do not rewrite the manuscript. We are mostly concerned with technical correctness and cor¬ 
rect use of idiom. We will not make significant adjustments to our writing or coding style on a 
global scale. Please send us a short e-mail if you would like to make a suggestion. 

• If you find something incorrect, please show us how to correct it. 

• In the later round(s) of review, please read all the back matter, including the exercises and any So¬ 
lutions we provide. 

• Please review the index we provide with each chapter to be sure we have covered the topics you 
feel are important. 
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Outline 

29.1 

Introduction 

29.2 

PHP 

29.3 

String Processing and Regular Expressions 

29.4 

Viewing Client/Server Environment Variables 

29.5 

Form Processing and Business Logic 

29.6 

Verifying a Username and Password 

29.7 

Connecting to a Database 

29.8 

Cookies 

29.9 

Operator Precedence 

29.10 

Internet and World Wide Web Resources 

Summary • Terminology • Self-Review Exercises • Answers to Self-Review Exercises • Exercises • 
Works Cited 


29.1 Introduction 

PHP, or PHP Hypertext Preprocessor, is quickly becoming one of the most popular server- 
side scripting languages for creating dynamic Web pages. PHP was created in 1994 by Ras- 
mus Lerdorf (who currently works for Linuxcare Inc. as a Senior Open-Source Researcher) 
to track users at his Web site. 1 In 1995, Lerdorf released it as apackage called the “Personal 
Home Page Tools.” PHP 2 featured built-in database support and form handling. In 1997, 
PHP 3 was released, featuring a rewritten parser, which substantially increased perfor- 
mance and led to an explosion in PHP use. It is estimated that over six million domains now 
use PHP. The release of PHP 4, which features the new Zend Engine and is much faster and 

<~s 

more powerful than its predecessor, should further increase PHP‘s popularity. More infor- 
mation about the Zend engine can be found at www. zend. com. 

PHP is an open-source technology that is supported by a large community of users and 
developers. Open source Software provides developers with access to the Software’s source 
code and free redistribution rights. PHP is platform independent; implementations exist for 
ali major UNIX, Linux and Windows operating systems. PHP also provides support for a 
large number of databases, including MySQL. 

After introducing the basies of the scripting language, we discuss viewing environment 
variables. Knowing information about a client’s exeeution environment allows dynamic 
content to be sent to the client. We then discuss form processing and business logic, which 
are vital to e-commerce applications. We provide an example of implementing a private 
Web site through username and password verification. Next, we build a three-tier, Web- 
based application that queries a MySQL database. Finally, we show how Web sites use 
cookies to store information on the client that will be retrieved during a client’s subsequent 
visits to a Web site. 
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29.2 PHP 


When the World Wide Web and Web browsers were introduced, the Internet began to 
achieve widespread popularity. This greatly increased the volume of requests for Informa¬ 
tion from Web servers. The power of the Web resides not only in serving content to users, 
but also in responding to requests from users and generating Web pages with dynamic con¬ 
tent. It became evident that the degree of interactivity between the user and the server 
would be crucial. While other languages can perform this function as well, PHP was written 
specifically for interacting with the Web. 

PHP code is embedded directly into XHTML documents. This allows the document 
author to write XHTML in a ciear, concise manner, without having to use multiple print 
statements, as is necessary with other CGI-based languages. Figure 29.1 presents a simple 
PHP program that displays a welcome message. 

In PHP, code is inserted between the scripting delimiters <?php and ?>. PHP code 
can be placed anywhere in XHTML markup, as long as the code is enclosed in these 
scripting delimiters. Line 8 declares variable $name and assigns to it the string "Paul". 
Ali variables are preceded by the $ special Symbol and are created the first time they are 
encountered by the PHP interpreter. PHP statements are terminated with a semicolon (;). 


Common Programming Error 29.1 



Failing to precede a variable name with a $ is a syntax error. 


1 <!DOCTYPE html PUBLIC 

2 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-strict.dtd"> 

3 

4 <! — Fig. 29.1: fig29_01.php --> 

5 <!-- Our first PHP script --> 

6 

7 < ?php 

8 $name = ; 


9 

10 

?> 


11 

<html xmlns = tp: / / 

www.w3 .org/1999/xhtml 11 > 

12 

<head> 


13 

<title>A simple 

PHP document </title> 

14 

15 

</head> 


16 

<body style = 

-size; 2em 11 > 

17 

<P> 


18 

19 

<strong> 


20 

<!-- print 

variable name's value 

21 

Welcome to 

PHP, <?php print ( 

22 

</strong> 


23 

</p> 


24 

</body> 


25 

</html> 



Fig. 29.1 Simple PHP program (part 1 of 2). 
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Fig. 29.1 Simple PHP program (part 2 of 2). 


Common Programming Error 29.2 



Variable names in PHP are case sensitive. Failure to use the proper mixture ofcase is a syn- 
tax error. 



Common Programming Error 29.3 


Forgetting to terminate a statement with a semicolon (;) is a syntax error. 


Line 8 contains a single-Iine comment, which begins with two forward slashes (//). 
Text to the right of the slashes is ignored by the interpreter. Comments can also begin with 
the pound sign (#). Multiline comments begin with delimiter / * and end with delimiter * /. 

Line 21 outputs the value of variable $name by calling function print. The actual 
value of $name is printed, instead of " $name ". When a variable is encountered inside a 
double-quoted (" ") string, PHP interpolates the variable. In other words, PHP inserts the 
variable’s value where the variable name appears in the string. Thus, variable $name is 
replaced by Paul for printing purposes. PHP variables are " multitype ", meaning that they 
can contain different types of data (e.g., integers , doubles or strings ) at different times. 
Figure 29.2 introduces these data types. 


Data type 

Description 

Integer 

Whole numbers (i.e., numbers without a decimal point). 

Double 

Real numbers (i.e., numbers containing a decimal point). 

String 

Text enclosed in either single ( 1 1 ) or double (" ") quotes. 

Boolean 

True or false. 

Array 

Group of elements of the same type. 

Object 

Group of associated data and methods. 

Resource 

An extemal data source. 

Null 

No value. 

Fig. 29.2 PHP data types. 
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Good Programming Practice 29.1 

Whitespace enhances the readability of PHP code. Ii also simplifies programming and de- 
bugging. 


PHP Scripts usually end with .php, although a server can be configured to handle 
other file extensions. To run a PHP script, PHP must first be installed on your system. Visit 
www.deitel.com for PHP installation and configuration instructions. Although PHP 
can be used from the command line, a Web server is necessary to take full advantage of the 
scripting language. Figure 29.3 demonstrates the PHP data types introduced in Fig. 29.2. 
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<!DOCTYPE html PUBLIC 


<!— Fig. 29.3: fig29_03.php --> 

<!— Demonstration of PHP data types --> 

<html xmlns = "http://www.w3.org/1999/xhtml"> 

<head> 

<title>PHP data types</title> 

</head> 


<body> 

<?php 


// declare a string, double and integer 

$testString = ; 

$testDouble = ; 

$testlnteger = ; 


?> 


<!-- print each variable's value --> 

<?php print ( $testString ) ?> is a string. <br /> 
<?php print ( $testDouble ) ?> is a double. <br /> 
<?php print ( $testlnteger ) ?> is an integer. <br /> 


<br /> 

Now, converting to other types :<br /> 
<?php 


// call function settype to convert variable 
// testString to different data types 

print ( ); 

settype( $testString, ); 

print ( 

print ( ) ; 

settype( $testString, ); 

print ( 

settype! $testString, ); 

print ( 


); 


); 


); 


Fig. 29.3 Type conversion example (part 1 of 2). 
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$value = 


?> 


// use type casting to cast variables to a 
// different type 
print ( 

. (string) $value . 

. (double) $value . 

. (integer) $value 


</body> 
</html> 


) ; 



Fig. 29.3 Type conversion example (part 2 of 2). 

Conversion between different data types may be necessary when performing arith- 
metic operations with variables. In PHP, data-type conversion can be performed by passing 
the data type as an argument to function settype. Lines 17-19 assign a string to variable 
$testString. a double to variable $testDouble and an integer to variable 
$testlnteger. Variables are converted the to data type of the value they are assigned. 
For example, variable $testString becomes a string when assigned the value "3.5 
seconds". Lines 23-25 print the value of each variable. Notice that the enclosing of 
a variable name in double quotes in a print statement is optional. Lines 34-39 call func¬ 
tion settype to modify the data type of each variable. Function settype takes two 
arguments: The variable whose data type is to be changed and the variable’s new data type. 
Calling function settype can resuit in loss of data. For example, doubles are truncated 
when they are converted to integers. When converting between a string and a number, PHP 
uses the value of the number that appears at the beginning of the string. If no number 
appears at the beginning of the string, the string evaluates to 0. In line 34, the string "3.5 
seconds" is converted to a double, resulting in the value 3.5 being stored in variable 
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$testString. In line 37, double 3 . 5 is converted to integer 3. When we convert this 
variable to a string (line 39), the variable’s value becomes "3". 

Another option for conversion between types is casting (or type casting). Unlike set- 
type, casting does not change a variable’s content. Rather, type casting creates a tempo- 
rary copy of a variable's value in memory. Lines 47-50 cast variable $data's value to a 
string, a double and an integer. Type casting is necessary when a specific data type 
is required for an arithmetic operation. 

The concatenatiori operator (.) concatenates strings. This combines multiple strings in 
the same print statement (lines 47-50). A print statement may be split over multiple 
lines; everything that is enclosed in the parentheses, terminated by a semicolon, is sent to the 
client. PHP provides a variety of arithmetic operators, which we demonstrate in Fig. 29.4. 


1 

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transi 


2 


onal.dtd" > 

3 



4 

<!-- Fig. 29.4: fig29_04.php --> 


5 

<!-- Demonstration of operators --> 


6 



7 

<html xmlns = "http://www.w3.org/1999/xhtml"> 


8 

<head> 


9 

<title>Using arithmetic operators</title> 


10 

</head> 


11 



12 

<body> 


13 

<?php 


14 

$a = ; 


15 

print ( 

); 

16 



17 

// define constant VALUE 


18 

define( , ); 


19 



20 

// add constant VALUE to variable $a 


21 

$a = $a + ; 


22 

print ( 


23 

) ; 


24 



25 

// multiply variable $a by 2 


26 

$a *= ; 


27 

print ( 

); 

28 



29 

// test if variable $a is less than 50 


30 

if ( $a < ) 


31 

print ( 

); 

32 



33 

// add 40 to variable #a 


34 

$a += 


35 

print ( 

); 

36 



37 

// test if variable $a is 50 or less 


38 

if ( $a < ) 


39 

print ( 

); 


Fig. 29.4 Using PHP's arithmetic operators (part 1 of 2), 
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// test if variable $a is between 50 and 100, inclusive 

elseif ( $a < ) 

print ( 

) ; 

else 

print ( 

) ; 


// add 10 to constant VALUE 

$test = 10 + ; 

print ( 


// add a string to an 

$str = ; 

$a += $str; 

print ( 


</body> 
</html> 


integer 


); 



Fig. 29.4 Using PHP's arithmetic operators (part 2 of 2), 


Line 14 declares variable $a and assigns it the value 5. Line 18 calls function def ine 
to create a named constant. A constant is a value that cannot be modified once it is declared. 
Function def ine takes two arguments: the name and value of the constant. An optional 
third argument accepts a boolean value that specifies whether the constant is case insensi- 
tive—constants are case sensitive by default. 


Common Programming Error 29.4 



Assigning a value to a constant after a constant is declared is a syntax error. 


Line 21 adds constant VALUE to variable $a, which is a typical use of arithmetic oper¬ 
ators. Line 26 uses the assignment operator *= to yield an expression equivalent to $a = 
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$a * 2 (thus assigning $a the value 20). These assignment operators (i.e., +=, -=, 
/=) are syntactical shortcuts. Line 34 adds 40 to the value of variable $a. 



Testing and Debugging Tip 29.1 


Always initialize variables before using them. Doing so helps avoid subtle errors. 


*= and 


Strings are converted to integers when they are used in arithmetic operations (lines 54- 
55). In line 55, the string value "3 dollars" is converted to the integer 3 before being 
added to integer variable $a. 



resl 


id Debugging Tip 29.2 


Function print can be used to display the value of a variable at a particular point during 
a program ’s execution. This is often helpful in debugging a script. 


Common Programming Error 29.5 


Using an uninitialized variable might resuit in an incorrect numerical calculation. For ex- 
ample, multiplying a number by an uninitialized variable results in 0. 



The words if, elseif and else are PHP keywords (Fig. 29.5), meaning that they are 
reserved for implementing language features. PHP provides the capability to store data in 
arrays. Arrays are divided into elements that behave as individual variables. Figure 29.6 dem- 
onstrates techniques for array initialization and manipulation. 


PHP keywords 


and 

do 

for 

include 

require 

true 

break 

else 

foreach 

list 

return 

var 

case 

elseif 

function 

new 

static 

Virtual 

class 

extends 

global 

not 

switch 

xor 

continue 

false 

if 

or 

this 

while 


default 


Fig. 29.5 PHP keywords. 

Individual array elements are accessed by following the array-variable name with an 
index enclosed in braces ([ ]). If a value is assigned to an array that does not exist, then the 
array is created (line 18). Likewise, assigning a value to an element where the index is 
omitted appends a new element to the end of the array (line 21). The for loop (lines 24- 
25) prints each element’s value. Function count returns the total number of elements 
in the array. Because array indices start at 0, the index of the last element is one less than 
the total number of elements. In this example, the for loop terminates once the counter 
($i) is equal to the number of elements in the array. 

Line 31 demonstrates a second method of initializing arrays. Function array returns 
an array that contains the arguments passed to it. The first item in the list is stored as the 
first array element, the second item is stored as the second array element, and so on. Lines 
32-33 use another for loop to print out each array element’s value. 

In addition to integer indices, arrays can have nonnumeric indices (lines 39-41). For 
example, indices Harvey, Paul and Tem are assigned the values 21,18 and 23, respec- 
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tively. PHP provides functions for iterating through the elements of an array (lines 45—46). 
Each array has a built-in interimi pointer, which points to the array element currently being 
referenced. Function reset sets the iterator to the first element of the array. Function key 
returns the index of the element to which the iterator points, and function next moves the 
iterator to the next element. The for loop continues to execute as long as function key 
returns an index. Function next retums false when there are no additional elements in 
the array. When this occurs, function key cannot return an index, and the script terminates. 
Fine 47 prints the index and value of each element. 

Function array can also be used to initialize arrays with string indices. In order to 
override the automatic numeric indexing performed by function array, use operator => 
as demonstrated on lines 54-61. The value to the left of the operator is the array index, and 
the value to the right is the element’s value. 

The foreach loop is a control structure that is specially designed for iterating 
through arrays (line 64). The syntax for a foreach loop starts with the array to iterate 
through, followed by the keyword as, followed by the variables to receive the index and 
the value for each element. We use the foreach loop to print each element and value 
of array $fourth. 


1 <!DOCTYPE html PUBLIC 

2 

3 

4 <! — Fig. 29.6: fig29_06.php --> 

5 <!-- Array manipulation --> 

6 

7 <html xmlns = "http://www.w3.org/1999/xhtml"> 

8 <head> 

<title>Array manipulation</title> 

10 </head> 

11 

12 <body> 

13 <?php 

14 


15 

// create array 

first 



16 

print ( 





17 


); 




18 

$first[ ] 

= 

r 



19 

$first[ ] 

= 

t 



20 

$first[ ] 

= 

r 



21 

$first[] = 


S 



22 






23 

// print each element's index and 

value 

24 

for ( $i = 

; $i 

< count ( 

$first ) 

; $i++ ) 

25 

print ( 




); 

26 






27 

print ( 





28 



); 



29 






30 

// call function 

array to 

create array second 

31 

$second = array ( 

r 

r 

# 

32 

for ( $i = 

; $i 

< count ( 

$second 

); $i++ ) 


Fig. 29.6 Array manipulation (part 1 of 3). 



© Copyright 1992-2002 by Deitel & Associates, Inc. AII Rights Reserved. 9/28/01 

































pythonhtpl_29.fm Page 1404 Friday, September 28, 2001 2:18 PM 


1404 PHP 


Chapter 29 


33^ 

prmt ( 

) 

i 


34 





35 

print ( 




36 

); 




37 





38 

// assign values to non-numerical indices 



39 

$third[ ] = ; 




40 

$third[ ] = ; 




41 

$third[ ] = ; 




42 





43 

// iterate through the array elements and print 

each 

44 

II element's name and value 




45 

for ( reset( $third ); $element = key( 

$third 

); 


46 

next( $third ) ) 




47 

print ( 



) ; 

48 





49 

print ( 




50 

); 




51 





52 

// call function array to create array 

fourth 

using 

53 

II string indices 




54 

$fourth = array( 




55 

= > 

= > 


r 

56 

= > 

= > 


r 

57 

= > 

= > 


r 

58 

= > 

= > 


# 

59 

= > 

= > 


# 

60 

= > 

= > 



61 

); 




62 





63 

II print each element's name and value 




64 

foreach ( $fourth as $element => $value 

) 



65 

print ( 



); 

66 

?> 




67 

</body> 




68 

</html> 





Fig. 29.6 Array manipulation (part 2 of 3). 
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Fig. 29.6 Array manipulation (part 3 of 3). 

29.3 String Processing and Regular Expressions 

PHP processes text data easily and efficiently, enabling straightforward searching, substi- 
tution, extraction and concatenation of strings. Text manipulation in PHP is usually done 
with regular expressions —a series of characters that serve as pattern-matching templates 
(or search criteria) in strings, text files and databases. This feature allows complex search¬ 
ing and string processing to be performed using relatively simple expressions. 

Many string-processing tasks are accomplished by using PHP's equality and comparison 
operators (Fig. 29.7). Line 16 declares and initializes array $fruits by calling function 
array. Lines 19-40 iterate through the array, comparing the array ’s elements to one another. 

Lines 23 and 25 call function strcmp to compare two strings. If the first string alpha- 
betically precedes the second string, then -1 is returned. If the strings are equal, then 0 is 
returned. If the first string alphabetically follows the second string, then 1 is returned. The 
for loop (line 19) iterates through each element in the $f ruits array. Lines 23-29 com- 
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pare each element to the string "banana", printing the elements that are greater than, less 
than and equal to the string. 

Relational operators (==, ! =, <, <=, > and >=) can also be used to compare strings. Lines 
33-38 use relational operators to compare each element of the array to the string "apple". 
These operators are also used for numerical comparison with integers and doubles. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 


<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" 
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-1 ransitional.dtd" > 

<!-- Fig. 29.7: fig29_07.php --> 

<!-- String Comparison --> 

<html xmlns = "http://www.w3.org/1999/xhtml"> 

<head> 

<title>String Comparison</title> 

</head> 

<body> 

<?php 

// create array fruits 

$fruits = array( , , ); 

// iterate through each array element 

for ( $i = ; $i < count( $fruits ); $i++ ) { 

// call function strcmp to compare the array element 
// to string "banana" 

if ( strcmp( $fruits[ $i ] , ) < ) 

print ( $fruits[ $i ] . ); 

elseif ( strcmp( $fruits[ $i ] , ) > ) 

print ( $fruits[ $i ]. 

); 

else 

print ( $fruits[ $i ] . ); 

// use relational operators to compare each element 

// to string "apple" 

if ( $fruits[ $i ] < ) 

print ( ) ; 

elseif ( $fruits[ $i ] > ) 

print ( ) ; 

elseif ( $fruits[ $i ] == ) 

print ( ) ; 


} 

?> 

</body> 
</html> 


Fig. 29.7 Using the string comparison operators (part 1 of 2). 
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Fig. 29.7 Using the string comparison operators (part 2 of 2). 


For more powerful string comparisons, PHP provides functions ereg and 
preg_match, which use regular expressions to search a string for a specified pattern. 
Function ereg uses Portable Operating System Interface (POSIX) extended regular 
expressions, whereas function preg_match provides Perl-compatible regular expres¬ 
sions. POSIX-extended regular expressions are a Standard to which PHP regular expres¬ 
sions conform. In this section, we use function ereg. Perl regular expressions are more 
widely used than POSIX regular expressions. Support for Perl regular expressions also 
eases migration from Perl to PHP. Consuit PHP’s documentation for a list of differences 
between the Perl and PHP implementations. Figure 29.8 demonstrates some of PHP’s reg¬ 
ular expression capabilities. 


1 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN 

2 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-transitional.dtd"> 

3 

4 <! — Fig. 29.8: fig29_08.php --> 

5 <!-- Using regular expressions --> 

6 

7 <html xmlns = "http://www.w3.org/1999/xhtml"> 

8 <head> 

<title>Regular expressions</title> 


10 

</head> 



11 




12 

<body> 



13 

<?php 



14 

$search = ; 


15 

print ( 

); 

16 




17 

// 

call function ereg to search 

for pattern 'Now' 

18 

// 

in variable search 


19 

if 

( ereg( , $search ) ) 


20 


print ( 

) ; 

21 




22 

// 

search for pattern 'Now' in 

the beginning of 

23 

// 

the string 


24 

if 

( ereg( , $search ) ) 


25 


print ( 


26 


); 



Fig. 29.8 Using regular expressions (part 1 of 2). 
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35 
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38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 


// search for pattern 'Now' at the end of the string 

if ( ereg( , $search ) ) 

print ( 

) ; 

// search for any word ending in 'ow' 

if ( ereg( , $search, 

$match ) ) 

print ( 

$match[ ] . ) ; 

// search for any words beginning with 't' 
print ( ); 

while ( eregi( , 

{search, $match ) ) { 
print ( $match[ ] . ); 


// remove the first occurrence of a word beginning 
// with 't' to find other instances in the string 

{search = ereg_replace( $match[ ], , {search ); 


print ( 

?> 

</body> 
</html> 


) ; 




Fig. 29.8 Using regular expressions (part 2 of 2). 

We begin by assigning the string "Now is the time" to variable $ search (line 
14). Line 19’s condition calls function ereg to search for the literal characters Now inside 
variable {search. If the pattern is found, ereg returns true, and line 20prints a mes- 
sage indicating that the pattern was found. We use single quotes (' ') inside the print 
statement to emphasize the search pattern. When located inside a string, content delimited 
by single quotes is interpolated. If a print statement uses only single quotes, the content 
inside the single quotes is not interpolated. For example, 

print( ); 
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in a print statement would output $name. Function ereg takes two arguments: a regu- 
lar expression pattern to search for (Now) and the string to search. Although case mixture 
and whitespace are typically significant in patterns, PHP provides function eregi for 
specifying case insensitive pattern matches. 

In addition to literal characters, regular expressions can include special characters that 
specify patterns. For example, the caret { A ) special character matches the beginning of a 
string. Line 24 searches the beginning of $ search for the pattern Now. 

The characters $, A and . are part of a special set of characters called metacharacters. 
A dollar sign ( $) searches for the specified pattern at the end of the string (line 29). Because 
the pattern Now is not found at the end of $ search, the body of the if statement (lines 
30-31) is not executed. Note that Now$ is not a variable, it is a pattern that uses $ to search 
for characters Now at the end of a string. Another special character is the period (.), which 
matches any single character. 

Lines 34-35 search (from left to right) for the first word ending with the letters ow. 
Bracket expressions are lists of characters enclosed in braces ([ ]), which match a single 
character from the list. Ranges can be specified by supplying the beginning and the end of 
the range separated by a dash (-). For instance. the bracket expression [a-z] matches any 
lowercase letter, and [A-Z] matches any uppercase letter. In this example, we combine 
the two to create an expression that matches any letter. The special bracket expressions 
[[:<:]] and [[:>]] match the beginning and end of a word, respectively. 

The expression inside the parentheses, [a-zA-z] *ow, matches any word ending in 
ow. It uses the quantifier * to match the preceding pattern 0 or more times. Thus, [a-zA- 
z] *ow matches any number of characters followed by the literal characters ow. Figure 29.9 
lists sonte PHP quantifiers. 

Placing a pattern in parentheses Stores the matched string in the array that is specified 
in the third argument to function ereg. The first parenthetical pattern matched is stored in 
the second array element. the second in the third array element, and so on. The first element 
(i.e., index 0) Stores the string matched for the entire pattern. The parentheses in lines 34- 
35 resuit in Now being stored in variable $match [ 1 ]. 


Quantifier 

Matches 

{n} 

Exactly n times. 

{m,n} 

Between m and n times inclusive. 

{n, } 

n or more times. 

+ 

One or more times (same as { 1, }). 

* 

Zero or more times (same as { 0 , }). 

•> 

Zero or one times (same as {0,1}). 


Fig. 29.9 Some PHP quantifiers. 


Searching for multiple instances of a pattern in a string is slightly more complicated, 
because the ereg function matches only the first instance of the pattern. To find multiple 
instances of a given pattern, we must remove any matched instances before calling ereg 
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again. Lines 42-49 use a while loop and the ereg_repla.ce function to find all the 
words in the string that begin with t. We will say more about this function momentarily. 

The pattern used in this example, [[:<:]] (t[[: alpha : ] ] +) [[:>:]], matches any 
word beginning with the character t followed by one or more characters. The example uses 
the character class [ [:alpha: ] ] to recognize any alphabetic character. This is equiva- 
lent to the [a-zA-Z] bracket expression that was used earlier. Figure 29.10 lists some 
character classes that can be matched with regular expressions. 

The quantifier + matches one or more instances of the preceding expression. The resuit 
of the match is stored in $match [ 1 ] . Once a match is found, we print it on line 44. 
We then remove it from the string on line 48, using function ereg_replace. Function 
ereg_replace takes three arguments: the pattern to match, a string to replace the 
matched string and the string to search. The modified string is returned. Here, we search for 
the word that we matched with the regular expression, replace the word with an empty 
string then assign the resuit back to $ search. This allows us to match any other words 
beginning with the character t in the string. 


29.4 Viewing Client/Server Environment Variables 


Knowledge of a client's execution environment is useful to system administrators who 
want to provide client-specific information. Environment variables contain information 
about a script’s environment, such as the client’s Web browser, the HTTP host and the 
HTTP connection. 

Figure 29.11 generates an XHTML document that displays the values of the client’s 
environment variables in a table. PHP Stores the environment variables and their values in 
the $GLOBALS array. Iterating through this array allows us to view all the client's envi¬ 
ronment variables. 

In lines 19-22, we use a foreach loop to print out the keys and values for each 
element in the $GLOBALS array. Individual array variables can be accessed directly by 
using an element’s key from the $GLOBALS array as a variable. For example, to receive 
information about the user’s browser, use the $HTTP_USER_AGENT variable. 
Figure 29.12 lists some global variables. 


Character Class 

Description 

alnum 

Alphanumeric characters (i.e., letters [a-z][A-Z] ordigits [0-9]). 

alpha 

Word characters (i.e., letters [a-z][A-Z]). 

digit 

Digits. 

space 

Whitespace. 

lower 

Lowercase letters. 

upper 

Uppercase letters. 


Fig. 29.10 Some PHP character classes, 
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1 

<! DOCTYPE html PUBLIC //W3C//DTD 3 

CHTML 1.0 Transitional//I 

2 

"http://www.w3.org/TR/xhtmll/DTD/ 

'xhtmll-transitional.dtd" 

3 

4 

<!-- Fig. 29.11: fig29_ll.php 

--> 

5 

<!-- Program to display environment 

variables --> 

6 

7 

<html xmlns = "http://www.w3.org/19i 

)9/xhtml "> 

8 

<head> 


9 

<title>Environment Variables</title> 

10 

11 

12 

</head> 


<body> 


13 

<table border = cellpadding = cellspacing = 

14 

width = "100V> 


15 

<?php 


16 

17 

// print the key and value 

for each element in the 

18 

// in the $GL0BALS array 


19 

foreach ( $GLOBALS as $key 

=> $value ) 

20 

print ( 


21 < st rong> $key</st rong> </ td> 

22 


) ; 

23 

?> 


24 

</table> 


25 

</body> 


26 

</html> 



Fig. 29.11 Displaying the environment variables (part 1 of 2), 
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Fig. 29.11 Displaying the environment variables (part 2 of 2) 


Variable Name 

Description 

$HTTP USER AGENT 

The client’s browser type. 

$ REMOTEADDR 

The clienfs IP address. 

$SERVER NAME 

Name of the server on which the script is running. 

$SERVER ADDR 

Address of the server on which the script is running. 

$HTTP GETVARS 

Data posted to the server by the gei method. 

$HTTP POSTVARS 

Data posted to the server by the post method. 

$HTTP COOKIEVARS 

Data contained in cookies on the client’s computer. 

$GLOBALS 

Array containing all global variables. 


Fig. 29.12 Some environment variables. 


29.5 Form Processing and Business Logic 

XHTML forms enable Web pages to collect data from users and send the data to a Web 
server for processing. Such interaction between users and Web servers is vital to e-com- 
merce applications, for example. Such capabilities allow users to purchase products, re- 
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quest information, send and receive Web-based e-mail, perform Online paging and take 
advantage of various other Online Services. Figure 29.13 uses an XHTML forra to collect 
information about users for the purpose of adding users to mailing lists. The type of regis- 
tration form in this example could be used by a Software company to acquire profile infor¬ 
mation before allowing users to download Software. 


1 

2 

3 

4 

5 

6 

7 

8 
9 


<!DOCTYPE html PUBLIC 


<!— Fig. 29.13: fig29_13.html --> 

<!-- Form for use with the form.php program --> 

<html xmlns = "http://www.w3.org/1999/xhtml"> 

<head> 

<title>Sample form to take user input in XHTML</title> 


10 

11 

12 

</head> 



<body> 



13 




14 

<hl This is a sample 

registration form.</hl> 

15 

Please fili in all fields and click Register. 

16 




17 

<!— post form data 

to form.php 

--> 

18 

<form method = post 

action = 

fig29 14.php"> 

19 

<img src = "image 


ait = /xbr 

20 

<span style = 

lor: blue"> 


21 

Please fili out the fields 

below.cbr /> 

22 

</span> 



23 




24 

<1 — create four 

text boxes for user input --> 

25 

<img src = "image 


ait = "First Name" 

26 

<input type = 

xt" name = " 

/xbr /> 

27 




28 

<img src = "image 


ait = "Last Name" 

29 

cinput type = "te 

xt" name = 

lnami /xbr /> 

30 




31 

<img src = "image 


ait = "Emai /> 

32 

<input type = "te 

xt" name = " 

email" /xbr /> 

33 




34 

<img src = "image 


ait = "Phone' /> 

35 

<input type = "te 

xt" name = " 

phone" /xbr /> 

36 




37 

<span style = 


t"> 

38 

Must be in the 

form (555)555-5555</ span> 

39 

<br /xbr /> 



40 




41 

<img src = "image 



42 

ait = 'Publica 

tions" /xbr 

/> 

43 




44 

<span style = 

lor: blue" > 


45 

Which book would you like 

information about? 

46 

</spanxbr /> 




/> 


/> 


Fig. 29.13 XHTML form for gathering user input (part 1 of 3). 
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47 




48 

<!— create drop-down 

list containing book names --> 

49 

<select name = loook > 



50 

<option> Internet and WWW How to Program 2e</option> 

51 

<option>C++ How to 

Program 

3e</option> 

52 

<option>Java How to Program 

4e</option> 

53 

<option>XML How to 

Program 

le</option> 

54 

</select> 



55 

<br /xbr /> 



56 




57 

<img src = images/os. 

gif" ait 

= "Operating System" /> 

58 

<br /xspan style = 


ue"> 

59 

Which operating System are 

you currently using? 

60 

<br /x/span> 



61 




62 

<!-- create five radio buttons 

--> 

63 

<input type = dio" 

name = 

os" value = "Windows NT" 

64 

checked = "checked" 

/> 


65 

Windows NT 



66 




67 

<input type = "radio" 

name = 

os value = 

68 

"Windows 2000" /> 



69 

Windows 2000 



70 




71 

<input type = "radio" 

name = 

os value = 

72 

"Windows 98" /> 



73 

Windows 98<br /> 



74 




75 

<input type = "radio" 

name = 

value = Linux' /> 

76 

Linux 



77 




78 

cinput type = "radio" 

name = " 

os" value = Other" /> 

79 

Other<br /> 



80 




81 

<!-- create a submit 

button - 

-> 

82 

< input type = >mit" 

value = 

"Register" /> 

83 

</form> 



84 




85 

< /body> 



86 

</html> 




Fig. 29.13 XHTML form for gathering user input (part 2 of 3). 
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Fig. 29.13 XHTML form for gathering user input (part 3 of 3). 


The action attribute of the form element (line 18) indicates that, when the user 
clicks Register, the form data will be posted to Fig. 29.14 for processing. Using 
method = "post" appends form data to the browser request which contains the protocol 
(i.e., HTTP) and the requested resource's URL. Scripts located on the Web server’s 
machine (or on a machine accessible through the network) can access the form data sent as 
part of the request. 

We assign a unique name (e.g., email) to each of the form’s input fields. When 
Register is clicked, each field’s name and value are sent to the Web server. 
Figure 29.14 can then accesses the submitted value for each specific field. 



Good Programming Practice 29.2 

Use meaningful XHTML object name s for input fields. This makes PHP Scripts that re- 
trieve form data easier to understand. 


Figure 29.14 processes the data posted by Fig. 29.13 and sends XHTML back to the 
client. For each form field posted to a PHP script, PHP creates a global variable with the 
same name as the field. For example, in line 32 of Fig. 29.13, an XHTML text box is cre- 
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ated and given the name email. Later in our PHP script (line 67), we access the field’s 
value by using variable $email. 

In lines 18-19, we determine whether the phone number entered by the user is valid. 
In this case, the phone number must begin with an opening parenthesis, followed by an area 
code, a closing parenthesis, an exchange, a hyphen and a line number. It is crucial to vali¬ 
date information that will be entered into databases or used in mailing lists. For example, 
validation can be used to ensure that credit-card numbers contain the proper number of 
digits before the numbers are encrypted to a merchant. The design of verifying information 
is called business logic (or business rides). 

The expression \ ( matches the opening parenthesis of the phone number. Because we 
want to match the literal character (, we escape its normal meaning by preceding it with 
the \ character. The parentheses in the expression must be followed by three digits ([0- 
91 {3}), a closing parenthesis, three digits, a literal hyphen and four additional digits. Note 
that we use the A and $ symbols to ensure that no extra characters appear at either end of 
the string. 


1 

2 

3 

4 

5 

6 

7 

8 
9 


<!DOCTYPE html PUBLIC 


<!-- Fig. 29.14: fig29_14.php 

<!-- Read information sent from form.html 

<html xmlns = "http://www.w3.org/1999/xhtii 

<head> 

<title>Form Validation</title> 


10 

11 

</head> 


12 

13 

<body style = "font-family: 

14 

15 

<?php 


16 

// 

determine if phone i 

17 

// 

an error message if 

18 

if 

( !ereg( 

19 

20 


$phone ) ){ 

21 

22 

23 

24 

25 

26 

27 

28 

29 

30 


print ( 

31 


die(); // terminate 

32 

} 


33 

34 

?> 



) ; 


Fig. 29.14 Obtaining user input through forms (part 1 of3). 
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35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 


<P>Hl 

<span style = color > 

<strong> 

<?php print( ); ?> 

</strong> 

</span> . 

Thank you for completing the survey.cbr /> 


You have been added to the 

<span style = > 

<strong> 

<?php print( ); ?> 

</strong> 

</span> 
mailing list. 

</p> 

<strong>The following information has been saved 
in our database: </strongxbr /> 


<table border = 

<tr> 

<td bgcolor = 
<td bgcolor = 
<td bgcolor = 
<td bgcolor = 
</tr> 


cellpadding = cellspacing = 

>Name </td> 

>Email</td> 

>Phone</td> 

>OS</td> 


<tr> 

<?php 

// print each form field's value 
print ( 


) ; 

?> 

</tr> 

</table> 

<br /xbr /xbr /> 

<div style = "font-size: lOpt; text-align: center"> 

This is only a sample form. 

You have not been added to a mailing list. 

</div> 

</body> 

</html> 


Fig, 29.14 Obtaining user inputthrough forms (part 2 of 3). 
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Fig, 29.14 Obtaining user inputthrough forms (part 3 of 3). 


If the regular expression is matched, then the phone number is determined to be valid, 
and an XHTML document is sent to the client, thanking the user for completing the form. 
Otherwise, the body of the if statement is executed, and an error message is printed. 

Function die (line 31) terminates script execution. In this case, if the user did not enter 
a correct telephone number, we do not want to continue executing the rest of the script, so 
we call function die. 



Use business logic to ensure that invalid Information is not stored in databases. When pos- 
sible, use JavaScript to validate form data while conserving server resources. However, 
some data, such as passwords, must be validated on the server-side. 


29.6 Verifying a Username and Password 

It is often desirable to have a private Web site —one that is accessible only to certain indi- 
viduals. Implementing privacy generally involves username and password verification. 
Figure 29.15 presents an XHTML form that queries the user for a username and a pass¬ 
word. Fields USERNAME and PASSWORD are posted to the PHP script f ig29_16 .php 
for verification. For simplicity, we do not encrypt the data before sending it to the server. 
For more information regarding PHP encryption functions, visit 

www.php.net/manual/en/ref.mcrypt .php 

[Note: These functions are not available for Windows distributions of PHP.] 


1 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN 

2 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-transitional.dtd"> 

3 

4 <!— Fig. 29.15: fig29 15.html --> 

Fig. 29.15 XHTML form for obtaining a username and password (part 1 of 3). 
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<!-- XHTML form sent to fig29 16.php for verification --> 

6 



7 

<html xmlns = "http://www.w3.org/19 

99/xhtml "> 

8 

<head> 


9 

<title>Verifying a username and a password. </title> 

10 



11 

<style type = > 


12 

td { background-color: 

j 

13 

</style> 


14 

</head> 


15 



16 

<body style = "font-family: aria 

.1' > 

17 

<P style = "font-size: 13pt"> 


18 

Type in your username and 

password below. 

19 

<br /> 


20 

<span style = 


21 

font-weight: bold"> 


22 

Note that password will 

be sent as plain text 

23 

</span> 


24 

</p> 


25 



26 

<!-- post form data to fig29_ 

16.php --> 

27 

<form action = "fig29_16.php" 

method = post' > 

28 

<br /> 


29 



30 

<table border = 0" cellspacing = "0" 

31 

style = leights 90px; 


32 

font-size: lOpt cellpadding = "0"> 

33 



34 

<tr> 


35 

<td colspan = > 


36 

<strong>Username : 

</strong> 

37 

</td> 


38 

</tr> 


39 



40 

<tr> 


41 

<td colspan = > 


42 

< input size = 40 

name = "USERNAME" 

43 

style = "heigh 


44 

</td> 


45 

</tr> 


46 



47 

<tr> 


48 

<td colspan = 3"> 


49 

<strong>Password: 

</strong> 

50 

</td> 


51 

</tr> 


52 



53 

<tr> 


54 

<td colspan = > 


55 

<input size = 40 

" name ■ "PASSWORD" 

56 

style = "heigh 


57 

type = "passwo 

rd" /> 

58 

<br/x/td> 



/> 


1419 


Fig. 29.15 XHTML form for obtaining a username and password (part 2 of 3). 
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39^ 

60 

</tr> 


61 

<tr> 


62 

<td colspan = "1"> 


63 

<input type = 

rnbmit" name = 

64 

value = 

style = 

65 


/> 

66 

</td> 


67 

<td colspan = "2"> 


68 

<input type = 

rnbmit 11 name = 

69 

value = 


70 

style = "hei;; 

jht : 23px /> 

71 

</td> 


72 

</tr> 


73 

</table> 


74 

</form> 


75 

</body> 


76 

</html> 




Fig. 29.15 XHTML form for obtaining a username and password (part 3 of 3). 

Figure 29.16 verifies the client’s username and password by querying a database. The 
valid user list and each user’s respective password is contained within a simple text file 
(Fig. 29.17). Existing users are validated against this text file, and new users are appended 
to it. 

First, lines 13-16 check whether the user has submitted a form without specifying a 
username or password. Variable names, when preceded by the logical negation operator 
(!), return true if they are empty or are set to 0. Logical operator OR (/ /) returns true 
if either of the variables are empty or are set to 0. If this is the case, function f ields- 
Blank is called (line 144), which notifies the client that all form fields must be completed. 

We determine whether we are adding a new user (line 19 in Fig. 29.16) by calling func¬ 
tion isset to test whether variable $NewUser has been set. When a user submits the 
XF1TML form in password. html. the user clicks either the New User or Enter button. 
This sets either variable $NewUser or variable $Enter, respectively. If variable 
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$NewUser has been set, lines 22-36 are executed. If this variable has not been set, we 
assume the user has pressed the Enter button, and lines 42-75 execute. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 


<!DOCTYPE html PUBLIC "-/ /W3C/ /DTD XHTML 1.0 Trans it ional/ /EN 
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-1 ransitional.dtd" > 


<!— Fig. 29.16: fig29_16.php --> 

<!— Searching a database for usernames and passwords --> 


<html xmlns = "http://www.w3.org/1999/xhtml"> 

<head> 

<?php 

// check if user has left USERNAME 
// or PASSWORD field blank 

if ( !$USERNAME || !$PASSWORD ) { 

fieldsBlank(); 
die(); 

} 


// check if the New User button was clicked 

if ( isset( $NewUser ) ) { 


// open fig29_17.txt for writing using append mode 

if ( !( $file = fopen( , 

) ) ) { 

// print error message and terminate script 
// execution if file cannot be opened 
print ( 


// write username and password to file and 

// call function userAdded 

fputs( $file, ); 

userAdded( $USERNAME ); 


} 

else { 


// if a new user is not being added, open file 
// for reading 

if ( !( $file = fopen( , 

) ) ) { 

print ( 


die(); 

} 


Fig. 29.16 Verifying a username and password (part 1 of 4). 
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30“ 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 
81 
82 

83 

84 

85 

86 

87 

88 

89 

90 

91 

92 

93 

94 

95 

96 

97 

98 

99 

100 
101 
102 

103 

104 


$userVerified = ; 

// read each line in file and check username 
// and password 

while ( !feof( $file ) && !$userVerified ) { 

II read line from file 

$line = fgets( $file, ); 

II remove newline character from end of line 

$line = chop( $line ); 

II split username and password 

$field = split( , $line, ); 

II verify username 

if ( $USERNAME == $field[ ] ) { 

$userVerified = ; 

// call function checkPassword to verify 
// user's password 

if ( checkPassword( $PASSWORD, $field ) 

== true ) 

accessGranted ( $USERNAME ); 

else 

wrongPassword(); 

} 

} 

// close text file 

fclose( $file ); 

II call function accessDenied if username has 
// not been verified 

if ( !$userVerified ) 
accessDenied(); 


II verify user password and return a boolean 

function checkPassword( $userpassword, $filedata ) 
{ 

if ( $userpassword == $filedata[ ] ) 

return true; 
else 

return false; 

} 


II print a message indicating the user has been added 

function userAdded( $name ) 

{ 

print ( 


Fig. 29.16 Verifying a username and password (part2 of 4). 
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TDF 

106 

107 

108 

109 

110 
111 
112 

113 

114 

115 

116 

117 

118 

119 

120 
121 
122 

123 

124 

125 

126 

127 

128 

129 

130 

131 

132 

133 

134 

135 

136 

137 

138 

139 

140 

141 

142 

143 

144 

145 

146 

147 

148 

149 

150 

151 

152 

153 

154 

155 


} 




// print a message indicating permission 

// has been granted 
function accessGranted( $name ) 

{ 

print ( 


} 


); 


// print a message indicating password is invalid 

function wrongPassword() 

{ 

print ( 


// print a message indicating access has been denied 

function accessDenied() 

{ 

print ( 


} 


) ; 


// print a message indicating that fields 
// have been left blank 

function fieldsBlank() 

{ 

print ( 


} 

?> 

</body> 
</html> 


) ; 


Fig. 29.16 Verifying a username and password (part3 of 4). 
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Fig. 29.16 Verifying a username and password (part 4 of 4). 


1 accountl.passwordl 

2 account2,password2 

3 account3,password3 

4 account4,password4 

5 account5,password5 

6 account6,password6 

7 account7,password7 

8 account8,password8 

9 account9,password9 
10 accountlO,passwordlO 


Fig. 29.17 Database f ig29_17 . txt containing usernames and passwords. 

To add a new user, we open the file f ig29_17 . txt by calling function fopen and 
assigning the file handle that is returned to variable $f ile (lines 22-23). A file handle is 
a number assigned to the file by the Web server for purposes of identification. Function 
fopen takes two arguments: The name of the file and the mode in which to open it. The 
possible modes include read, write and append. Here, we open the file in append 
mode, which opens it for writing, but does not write over the previous contents of the file. 
If an error occurs in opening the file, function fopen does not return a file handle and an 
error message is printed (lines 27-29), and script execution is terminated by calling func¬ 
tion die (line 30). If the file opens properly, function fputs (line 35) writes the name and 
password to the file. To specify a new line, we use the newline character (\n). This places 
each username and password pair on a separate line in the file. On line 36, we pass the vari¬ 
able $USERNAME to function userAdded (line 98). Function userAdded prints a 
message to the client to indicate that the username and password were added to the file. 
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If we are not adding a new user, we open the file f ig29_17 . txt for reading. This 
is accomplished by using function f open and assigning the file handle that is returned to 
variable $f ile (lines 42-43). Lines 44-47 execute if an error occurs in opening the file. 
The while loop (line 54) repeatedly executes the code enclosed in its curly braces (lines 
57-75) until the test condition in parentheses evaluates to false. Before we enter the 
while loop, we set the value of variable $userVerif ied to 0. In this case, the test con¬ 
dition (line 54) checks to ensure that the end of the file has not been reached and that the 
user has not been found in the password file. Logical operator AND (&&) connects the two 
conditions. Function feof, preceded by the logical negation operator (!), returns true 
when there are more lines to be read in the specified file. When the logical negation oper¬ 
ator (!) is applied to the $userVerif ied variable, true is returned if the variable is 
empty or is set to 0. 

Each line in f ig29_17 . txt consists of ausername and password pair that is separated 
by a comma and followed by a newline character. A line from this file is read using function 
fgets (line 57) and is assigned to variable $line. 

This function takes two arguments: The file handle to read, and the maximum number of 
characters to read. The function reads until a newline character is encountered, the end of the 
file is encountered or the number of characters read reaches one less than the number speci¬ 
fied in the second argument. 

For each line read, function chop is called (line 60) to remove the newline character 
from the end of the line. Then, function split is called to divide the string into substrings 
at the specified separator, or delimiter (in this case, a comma). For example, function 
split returns an array containing ("accountl" and "passwordl") from the first 
line in f ig29_17 . txt. This array is assigned to variable $f ield. 

Line 66 determines whether the username entered by the user matches the one returned 
from the text file (stored in the variable $f ield [ 0 ]). If the condition evaluates to true, 
then the $userVerif ied variable is set to 1, and lines 71-75 execute. On line 71, func¬ 
tion checkPassword (line 89) is called to verify the user’s password. Variables 
$ PASSWORD and $f ield are passed to the function. Function checkPassword com¬ 
pares the user’s password to the password in the file. If they match, true is returned (line 
92), whereas false is returned if they do not (line 94). If the condition evaluates to true, 
then function accessGranted (line 110) is invoked. Variable $USERNAME is passed to 
the function, and a message notifies the client that permission has been granted. However, 
if the condition evaluates to false, then function wrongPassword is invoked (line 
121), which notifies the client that an invalid password was entered. 

When the while loop is complete, either as a resuit of matching a username or of 
reaching the end of the file, we are finished reading from f ig2 9_17 . txt. We c al\ func¬ 
tion fclose (line 80) to close the file. Line 84 checks whether the $userVerif ied 
variable is empty or has a value of 0, which indicates that the username was not found in 
the f ig29_17 . txt file. If this returns true, function accessDenied is called (line 
132). This function notifies the client that access to the server has been denied. 

29.7 Connecting to a Database 

Databases enable companies to enter the world of e-commerce by maintaining crucial data, 
and database connectivity allows system administrators to maintain and update such infor- 
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mation as user accounts, passwords, credit-card numbers, mailing lists and product inven- 
tories. PHP offers built-in support for a wide variety of databases. In this example, we use 
MySQL. Visit www.deitel. comto locate information on setting up a MySQL database. 
From a Web browser, the client enters a database field name that is sent to the Web server. 
The PHP script is then executed; the script builds the select query, queries the database and 
sends a record set in the form of XHTML to the client. The rules and syntax for writing 
such a query string are discussed in Chapter 17, Python Database Application Program- 
ming Interface (DB-API). 

Figure 29.18 is a Web page that posts form data containing a database field to the 
server. The PHP script in Fig. 29.19 processes the form data. 

Line 17 creates an XHTML form, specifying that the data submitted from the form 
will be sent to Fig. 29.19. Lines 22-28 add a select box to the form, set the name of the 
select box to select, and set its default selection to *. This value specifies that ali records 
are to be retrieved from the database. Each database field is set as an option in the select 
box. 


1 

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 


2 

"http://www.w3.org/TR/xhtml1/DTD/xhtml1-t 


3 



4 

<!-- Fig. 29.18: fig29_18.html —> 


5 

<!-- Querying a MySQL Database --> 


6 



7 

<html xmlns = "http://www.w3.org/1999/xhtml" 

> 

8 

<head> 


9 

<title>Sample Database Query</title> 


10 

11 

</head> 


1 1 

12 

<body style = "background-color: #F0E68C" 

> 

13 

<h2 style = "font-family: arial color: 

blue "> 

14 

Querying a MySQL database. 


15 

</h2> 


16 



17 

<form method = post action = 'databa 

se *php"> 

18 

<p>Select a field to display: 


19 



20 

<!— add a select box containing 

options —> 

21 

<!-- for SELECT query 

--> 

22 

<select name = ect"> 


23 

<option selected = "selected" 

>*</option> 

24 

<option>ID</option> 


25 

<option>Title</option> 


26 

<option>Category :/option> 


27 

<option>ISBN</option> 


28 

</select> 


29 

</p> 


30 



31 

cinput type = value = 


32 

style = "background-color: blue; 


33 


" /> 

34 

</form> 



Fig. 29.18 Form to query a MySQL database (part 1 of 2). 



© Copyright 1992-2002 by Deitel & Associates, Inc. AII Rights Reserved. 9/28/01 

































pythonhtpl_29.fm Page 1427 Friday, September 28, 2001 2:18 PM 


Chapter 29 


1427 


"35 </body> 

36 </html> 



Fig. 29.18 Form to query a MySQL database (part 2 of 2). 


1 

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTMI 





2 






1" > 

3 







4 

<!-- Fig. 29.19: fig29_19.php --> 





5 

<!— Program to query database and --> 





6 

7 

<!-- send results to Client --> 





8 

chtml xmlns 

a "http: //www.w3 .orci/1999/x] 


> 



9 

<head> 






10 

<title>Search Results</title> 





11 

</head> 






12 







13 

<body style = "font-family: 





14 

style 

= "background-color: #F0E68< 

> 




15 

<?php 






16 







17 

II 

build SELECT query 





18 

$query = . $select . 



i 


19 







20 

II 

Connect to MySQL 





21 

if 

( !( $database = mysql_connect( 


§ 


22 


, ) ) ) 





23 


die ( 



); 


24 







25 

I/ 

open Products database 





26 

if 

( !mysql_select_db( 

# 

$database ) ) 


27 


die ( 



); 


28 







29 

II 

query Products database 





30 

if 

( !( $result = mysql_query( 

$query. 

$database ) 

' ) ) { 

31 


print ( 



); 


32 


die( mysql error() ); 






Fig. 29.19 Querying a database and displaying the results (part 1 of 3). 
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34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 


?> 


> 


<h3 style = ' color: blue"> 

Search Results</h3> 


<table border = cellpadding = 

style = "background-color: #AD 


cellspacing = 
> 


<?php 

// fetch each record in resuit set 

for ( $counter = ; 

$row = mysql_fetch_row( $result ); 
$counter++ ){ 


// build table to display results 
print ( ); 


foreach ( 
print ( 


$row as $key => $value ) 
); 


print ( 

} 


) ; 


mysql_close( $database ); 

?> 


</table> 

<br />Your search yielded <strong> 

<?php print ( ) ?> results. <br /xbr /></strong> 

<h5>Please email comments to 

<a href = "mailto:deitel@deitel.com"> 

Deitel and Associates, Inc. 

</a> 

</h5> 


</body> 
</html> 


Fig. 29.19 Querying a database and displaying the results (part 2 of 3). 
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Fig, 29,19 Querying a database and displaying the results (part 3 of 3). 

Figure 29.19 builds an SQL-query string with the specified field name and sending it 
to the database-management system. Line 18 concatenates the posted field name to a 
SELECT query. Line 21 calls function mysql_connect to connect to the MySQL data¬ 
base. We pass three arguments to function mysql_connect: The server"s hostname, a 
username and a password. This function returns a database handle —a reference to the 
object that is used to represent PHP"s connection to the database—which we assign to vari- 
able $database. If the connection to MySQL fails, function die is called, which outputs 
an error message and terminates the script. Line 26 calls function mysql_select_db to 
specify the database to be queried (in this case, Products). Function die is called if the 
database cannot be opened. To query the database, line 30 calls function mysql_query, 
specifying the query string and the database to query. Function mysql_query returns an 
object containing the resuit set of the query, which we assign to variable $result. If the 
query of the database fails, a message is output to the client indicating that the query failed 
to execute. Function die is then called, accepting function mysql_error as a parameter 
instead of a string message. In the event that the query fails, function mysql_error 
returns any error strings from the database. Function mysql_query can also be used to 
execute SQL statements, such as INSERT or DELETE, that do not return results. 

Lines 45-56 use a for loop to iterate through each record in the resuit set while con- 
structing an XFITML table from the results. The loop condition calls function 
mysql_fetch_rowto return an array containing the elements of each row in the resuit 
set of our query ($result). The array is then stored in variable $row. Lines 52-53 use a 
foreach loop to construet individual cells for each of the elements in the row. The 
f oreach loop takes the name of the array ($row), iterates through each index value of 
the array ($key) and Stores the element in variable $value. Each element of the array is 
then printed as an individual cell. For each row retrieved, variable $counter is incre- 
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mented by one. When the end of the resuit set has been reached, undef (false) is 
returned by function mysql_fetch_row, which terminates the for loop. 

After all rows of the resuit set have been displayed, the database is closed (line 58), and 
the table's closing tag is written (line 61). The number of results contained in $counter 
is printed in line 64. 


29.8 Cookies 


A cookie is a text file that a Web site Stores on a client’s computer to maintain information 
about that client during and between browsing sessions. A Web site can store a cookie on 
a client’s computer to record user preferences and other information, which the Web site 
can retrieve during that client's subsequent visits. For example, many Web sites use cook¬ 
ies to store clients" zip codes. The Web site can retrieve the zip code from the cookie and 
provide weather reports and news updates tailored to the user’s region. Web sites also can 
use cookies to track information about client activity. Analysis of information collected via 
cookies can reveal the popularity of various Web sites or products. In addition, marketers 
can use cookies to determine the effects of particular advertising campaigns. 

Web sites store cookies on users’ hard drives, which raises issues regarding security 
and privacy. Web sites should not store critical information, such as credit-card numbers or 
passwords in cookies, because cookies are text files that any program can read. Several 
cookie features address security and privacy concerns. A particular server can access only 
the cookies that server placed on the client. For example, a Web application running on 
www.deitel.com cannot access cookies that the Web site www.prenhall.com/ 
deitel may have placed on the client’s computer. A cookie also has a maximum age, 
after which the Web browser deletes that cookie. Users who are concerned about the pri¬ 
vacy and security implications of cookies can disable cookies in their Web browsers. How- 
ever, the disabling of cookies can prevent those users from interacting with Web sites that 
rely on cookies to function properly. 

Microsoft Internet Explorer Stores cookies as small text files on the client’s hard drive. 
The information stored in the cookie is sent back to the Web server from which it originated 
whenever the user requests a Web page from that particular server. The Web server can 
send the client XHTML output that reflects the preferences or information that is stored in 
the cookie. 

Figure 29.20 uses a script to write a cookie to the client’s machine. The script displays 
an XHTML f orm that allows a user to enter a name, height and favorite color. When the 
user clicks the Write Cookie button, the script in Fig. 29.21 executes. 



Some clients do not accept cookies. When a client declines a cookie, the browser application 
normally informs the client that the site may not function correctly without cookies enabled. 



Cookies cannot be used to retrieve e-mail addresses or data from the hard drive ofa client’s 
computer. 
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Figure 29.21 calls function setcookie to set the cookies to the values passed from 
cookies . html . Function setcookie prints XF1TML header information, therefore, it 
needs to be called before any other XFITML (including comments) is printed. 

Function setcookie takes the name of the cookie to be set as the first argument, fol- 
lowed by the value to be stored in the cookie. For example, line 7 sets the name of the 
cookie to "Name" and the value to variable $NAME, which is passed to the script from 
Fig. 29.20. The optional third argument indicates the expiration date of the cookie. In this 
example, we set the cookies to expire in five days by taking the current time, which is 
returned by function time, and adding the number of seconds after which the cookie 
should expire (60 seconds * 60 minutes * 24 hours * 5 days). If no expiration date is spec- 
ified, the cookie only lasts until the end of the current session, which is the total time until 
the user closes the browser. If only the name argument is passed to function setcookie, 
the cookie is deleted from the cookie database. Lines 12-37 send a Web page to the client 
indicating that the cookie has been written and listing the values that are stored in the 
cookie. Lines 34-35 provide a link to Fig. 29.24. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 


<!DOCTYPE html PUBLIC 


> 


<!-- Fig. 29.20: fig29_20.html --> 
<!-- Writing a Cookie --> 


<html xmlns = "http://www.w3.org/1999/xhtml"> 

<head> 

<title>Writing a cookie to the Client computer</title> 

</head> 


cbody style = 


<h2>Click Write Cookie to save your cookie data.</h2> 

<form method = jos action = ig29_21.php" 

style = :ont-size: lOp > 

<strong>Name:</strongxbr /> 

cinput type = "text" name = "NAME" /xbr /> 

<strong>Height : </strongxbr /> 

cinput type = "text" name = IEIGH /xbr /> 

<strong>Favorite Color: </strongxbr /> 
cinput type = name = tOLOB /xbr /> 

cinput type = "submit" value = "Write Cookie" 


29 style = "background-color: #F0E86C; 

30 font-weight: bold' />c/p> 

31 c/form> 

32 c/body> 

Fig. 29.20 Gathering data to be written as a cookie (part 1 of 2). 
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"33 </html> 



Fig, 29,20 Gathering data to be written as a cookie (part 2 of 2). 


1 < ?php 

2 // Fig. 29.21: fig29_21.php 

3 // Program to write a cookie to a Client's machine 

4 

5 // write each form field's value to a cookie and set the 

6 // cookie's expiration date 

setcookie( , $NAME, time() + * * * ); 

setcookie( , $HEIGHT, time() + * * * ); 

setcookie( , $COLOR, time() + * * * ); 

10 ?> 

11 

12 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN 

13 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-transitional.dtd" > 

14 

15 <html xmlns = "http://www.w3.org/1999/xhtml"> 

16 <head> 

17 <title>Cookie Saved< /title> 

18 </head> 

19 

20 <body style = "font-family: arial, sans-serif"> 

<p>The cookie has been set with the following data:</p> 

22 

23 <!-- print each form field's value --> 

24 <br /xspan style = >Name : </span> 

25 <?php print ( $NAME ) ?><br /> 

26 

<span style = >Height: </span> 

28 <?php print ( $HEIGHT ) ?><br /> 

Fig. 29.21 Writing a cookie to the Client (part 1 of 2). 
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30 

<span style = "color- 

>Favorite Color : </span> 

31 

32 

<span style = "color: 

<?php print( 

33 

</spanxbr /> 


34 

<p>Click <a href = 

>here</a> 

35 

to read the saved 

cookie. </p> 

36 

</body> 


37 

</html> 




Fig. 29.21 Writing a cookie to the Client (part 2 of 2). 


If the client is Internet Explorer, cookies are stored in the Cookies directory on the 
client’s machine. Figure 29.22 shows the contents of this directory prior to the execution of 
Fig. 29.21. After the cookie is written, a text file is added to the directory. In Fig. 29.23, the 
file petel@loca.lh.ost appears in the Cookies directory. 



Fig. 29.22 Cookies directory before a cookie is written. 
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Fig. 29.23 Cookies directory after a cookie is written. 

Figure 29.24 reads the cookie that is written in Fig. 29.21 and displays the cookie’s 
information in a table. 

PFIP creates variables containing contents of a cookie, similar to when values are 
posted via forms. Thus, the next time a script is run from a location where the cookie is vis- 
ible, a cookie set with the nante "Color" is assigned to variable $Color along with its 
corresponding value. PFIP also creates array $HTTP_COOKIE_VARS, which contains ali 
the cookie values indexed by their names. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 
29 


<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN 
"http://www.w3.org/TR/xhtmll/DTD/xhtmll-transitional.dtd"> 


<!-- Fig. 29.24: fig29_24.php --> 

<!— Program to read cookies from Client's computer --> 

<html xmlns = ‘http://www.w3.org/1999/xhtml"> 

<headxtitle>Read Cookies</titlex/head> 

<body style = "font-family: arial, sans-serif "> 

<P> 

<strong> 

The following data is saved in a cookie on your 
computer. 

</strong> 

</p> 

<table border = cellspacing = cellpadding = > 

<?php 

// iterate through array $HTTP COOKIEVARS and print 
// name and value of each cookie 

foreach ( $HTTP_COOKIE_VARS as $key => $value ) 

print ( 


?> 


); 


Fig. 29.24 Displaying the cookie's contents (part 1 of 2). 
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30 

31 </table> 

32 </body> 

33 </html> 



Fig. 29.24 Displaying the cookie's contents (part 2 of 2). 

Lines 24-28 iterate through this array using a f oreach loop, printing out the name 
and value of each cookie in an XHTML table. The f oreach loop takes the name of the 
array ($HTTP_COOKIE_VARS) and iterates through each index value of the array 
($key). In this case, the index value is the name of each cookie. Each element is then stored 
in variable $value, and these values become the individual cells of the table. 

29.9 Operator Precedence 

This section contains the operator precedence chart for PHP. In Fig. 29.25, the operators 
are shown from top to bottom in decreasing order of precedence. 


Operator 

Type 

Associativity 

new 

constructor 

none 

n 

subscript 

right to left 

- 

bitwise not 

right to left 

! 

not 


+ + 

increment 


-- 

decrement 


- 

unary negative 

(This level continued at 


error control 

top ofnext page) 


Fig. 29.25 PHP operator precedence and associativity (part 1 of 3). 
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Operator 

Type 

Associativity 


bitwise not 

(This level continued 

! 

not 

from bottom ofprevious 

+ + 

increment 

page) 

-- 

decrement 


- 

unary negative 



error control 


* 

multiplication 

left to right 

/ 

di vision 


% 

modulus 


+ 

addition 

left to right 

- 

subtraction 


• 

concatenation 


<< 

bitwise shift left 

left to right 

>> 

bitwise shift right 


< 

less than 

none 

> 

greater than 


< = 

less than or equal 


> = 

greater than or equal 


= = 

equal 

none 

! = 

not equal 


= = = 

identical 


!= = 

not identical 


& 

bitwise AND 

left to right 

A 

bitwise XOR 

left to right 

1 

bitwise OR 

left to right 

&& 

logical AND 

left to right 

1 1 

logical OR 

left to right 

= 

assignment 

left to right 

+ = 

addition assignment 


- = 

subtraction assignment 


* = 

multiplication assignment 


/ = 

di vision assignment 


&= 

bitwise AND assignment 


1 = 

bitwise OR assignment 


A — 

bitwise exclusive OR assignment 


. = 

concatenation assignment 


<< = 

bitwise shift left assignment 


>> = 

bitwise shift right assignment 


and 

logical AND 

left to right 


Fig. 29.25 PHP operator precedence and associativity (part 2 of 3). 
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Operator 

Type 

Associativity 

xor 

exclusive OR 

left to right 

or 

logical OR 

left to right 

# 

list 

left to right 

Fig. 29.25 

PHP operator precedence and associativity (part 3 of 3). 


29.10 Internet and World Wide Web Resources 

www.php.net 

This official PHP site contains the latest versions of PHP, as well as documentation, a list of FAQs, 
support and links to many other PHP resources. 

www.zend.com 

This site is the home of Zend Technologies , the developers of the Zend scripting engine. The site also 
provides code, tips and applications for PHP developers. 

www.phpbuilder.com 

This site contains resources for PHP developers. The site also includes a search feature and provides 
links to articles, code and forums. 

www.phpworld.com 

This site provides PHP-related resources, including articles. documentation, links and a help board. 

php.resourceindex.com 

This site provides access to the PHP community, helping visitors find jobs, chats, developer sites and 
more. The code section of the site contains Scripts, functions and classes. In addition, visitors can sign 
up to receive e-mail updates regarding new resources. 

www.phpwizard.net 

This site contains resources for PHP development. It provides tutorials, links and many other resources. 

phpclub.unet.ru 

This Web page contains manuals, forums, links, books, databases, a FAQ list and other PHP resources. 


SUMMARY 

• PHP is an open-source technology that is supported by a large community of users and developers. 
PHP is platform independent; implementations exist for all major UNIX, Linux and Windows op- 
erating systems. 

• PHP code is embedded directly into XHTML documents and provides support for a wide variety 
of different databases. PHP Scripts typically have the file extension -php. 

• In PHP, code is inserted in special scripting delimiters that begin with <?php and end with ?>. 

• Variables are preceded by the $ special Symbol. A variable is created automatically when it is first 
encountered by the PHP interpreter. 

• PHP statements are terminated with a semicolon (;). Comments begin with two forward slashes 
(//). Text to the right of the slashes is ignored by the interpreter. 


© Copyright 1992-2002 by Deitel & Associates, Inc. AII Rights Reserved. 9/28/01 


































pythonhtpl_29.fm Page 1438 Friday, September 28, 2001 2:18 PM 



4 ^- 


1438 PHP 


Chapter 29 



• When a variable is encountered inside a double-quoted (" ") string, PHP uses interpolation to re- 
place the variable with its associated data. 

• PHP variables are multitype, meaning that they can contain different types of data— integers, 
floating-point numbers or strings. 

• Type casting converts between data types without changing the value of the variable itself. 

• The concatenation operator (.) appends the string on the right of the operator to the string on the 
left. 

• Uninitialized variables have the value undef, which evaluates to different values, depending on 
the context. When undef is used in a numeric context, it evaluates to 0. When undef is inter- 
preted in a string context, it evaluates to an empty string (" "). 

• Strings are automatically converted to integers when they are used in arithmetic operations. 

• PHP provides the capability to store data in arrays. Arrays are divided into elements that behave 
as individual variables. 

• Individual array elements are accessed by following the array-variable name with the index num- 
ber in braces ([ ]). If a value is assigned to an array that does not exist, the array is created. In ad- 
dition to integer indices, arrays can also have nonnumeric indices. 

• Function count returns the total number of elements in the array. Function array takes a list of 
arguments and returns an array. Function array may also be used to initialize arrays with string 
indices. 

• Function reset sets the iterator to the first element of the array. Function key returns the index 
of the current element. Function next moves the iterator to the next element. 

• The f oreach loop is a control structure that is specifically designed for iterating through arrays. 

• Text manipulation in PHP is usually done with regular expressions—a series of characters that 
serve as pattern-matching templates (or search criteria) in strings, text files and databases. This 
feature allows complex searching and string processing to be performed using relatively simple 
expressions. 

• Function strcmp compares two strings. If the first string alphabetically precedes the second 
string, -1 is returned. If the strings are equal, 0 is retumed. If the first string alphabetically follows 
the second string, 1 is returned. 

• Relational operators (==, ! =, <, <=, > and > = ) can be used to compare strings. These operators 
can also be used for numerical comparison of integers and doubles. 

• For more powerful string comparisons, PHP provides functions ereg and preg_match, which 
use regular expressions to search a string for a specified pattem. 

• Function ereg uses POSIX extended regular expressions, whereas function preg_match pro¬ 
vides Perl compatible regular expressions. 

• The caret ( A ) matches the beginning of a string. A dollar sign ($) searches for the specified pattern 
at the end of the string. The period (.) is a special character that is used to match any single char¬ 
acter. The \ character is an escape character in regular expressions. 

• Bracket expressions are lists of characters enclosed in square brackets ([ 3) that match a single 
character from the list. Ranges can be specified by supplying the beginning and the end of the 
range separated by a dash (-). 

• The special bracket expressions [[:<:]] and [[:>]] match the beginning and end of a word. 

• Character class [[:alpha:]] matches any alphabetic character. 

• The quantifier + matches one or more instances of the preceding expression. 
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• Function ereg_replace takes three arguments: The pattern to search, a string to replace the 
matched string and the string to search. 

• PHP Stores environment variables and their values in the $GLOBALS array. Individual array vari- 
ables can be accessed directly by using an elemenfs key from the $GLOBALS array as a variable. 

• For each fonti field posted to a PHP script, PHP creates a variable with the same name as the field. 

• Function die terminates script execution. 

• Passing a string argument to the die function prints that string a message before stopping program 
execution. 

• Function isset tests whether a variable has been set. 

• Function f open opens a text file. 

• A file handle is a number that the server assigns to the file and is used when the server accesses 
the file. 

• Function f open takes two arguments: The name of the file and the mode in which to open the 
file. The possible modes include read. write and append. 

• Function f eof , preceded by the logical negation operator (!), returns true when there are more 
lines to be read in a specified file. 

• A line from a text file is read using function fgets. This function takes two arguments: The file 
handle to read and the maximum number of characters to read. 

• Function chop removes newline characters from the end of a line. Function split divides a 
string into substrings at the specified separator or delimiter. Function f close closes a file. 

• Function mysql_connect connects to a MySQL database. This function returns a database han¬ 
dle—a reference to the object which is used to represent PHP's connection to the database. Function 
mysql_query returns an object that contains the resuit set of the query. Function mysql_error 
returns any error strings from the database if the query fails. Function mysql_f etch_row returns 
an array that contains the elements of each row in the resuit set of a query. 

• Cookies maintain state information for a particular client who uses a Web browser. Cookies are 
often used to record user preferences or other information that will be retrieved during a client’s 
subsequent visits to a Web site. On the server side, cookies can be used to track information about 
client activity. 

• The data stored in the cookie is sent back to the Web server from which it originated whenever the 
user requests a Web page from that particular server. 

• Function setcookie sets a cookie. Function setcookie takes as the first argument the name 
of the cookie to be set, followed by the value to be stored in the cookie. 

• PHP creates variables containing contents of a cookie, similar to when values are posted via forms. 

• PHP creates array $HTTP_COOKIE_VARS. which contains ali the cookie values indexed by their 
names. 


TERMINOLOGY 

$ metacharacter 
$GLOBALS variable 
$HTTP COOKIEVARS 
append 
array function 
array_splice function 
as 


assignment operator 
backslash 
bracket expression 
caret metacharacter ( A ) in PHP 
character class 
chomp function 
comparison operator 
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concatenatiori operator 
count function 
current function 
database connectivity 
database handle 
delimiter 
die function 
doubleval function 
environment variable 
equality operator 
ereg function 
ereg_replace function 
eregi function 
fclose function 
f eof function 
fgets function 
filehandle 
f open function 
f oreach loop 
fputs function 
HTTP connection 
HTTP host 

Hypertext Preprocessor 

index value 

interpolation 

intval function 

isset function 

key function 

literal character 

logical AND operator 

logical negation operator (!) 

metacharacter 

MySQL 

mysql_connect function 


mysql_error function 
mysql_f etch_row function 
mysql_query function 
mysql_selectdb function 
newline character 
next function 
parenthetical memory in PHP 
Perl compatible regular expression 
PHP (Hypertext Preprocessor) 

PHP comment 
PHP keyword 
pos function 

POSIX extended regular expression 

preg_match function 

print function 

printf function 

quantifier 

read 

regular expression 

reset 

resuit set 

setcookie function 
settype function 
split function 
SQL query string 
strcmp function 
string context 
strval function 
typecasting operator 
undef 
validation 
Web server 
while loop 
write 


SELF-REVIEW EXERCISES 

29.1 State whether the following are true or false. If false, explain why. 

a) PHP code is embedded directly into XHTML. 

b) PHP function names are case sensitive. 

c) The strval function permanently changes the type of a variable into a string. 

d) Conversion between data types happens automatically when a variable is used in a con¬ 
text that requires a different data type. 

e) The f oreach loop is a control structure that is designed specifically for iterating over 
arrays. 

f) Relational operators can be used for alphabetic and numeric comparison. 

g) The quantifier +, when used in a regular expression, matches any number of the preced- 
ing pattern. 

h) Opening a file in append mode causes the file to be overwritten. 

i) Cookies are stored on the server computer. 

j) The * arithmetic operator has higher precedence than the + operator. 
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29.2 Fili in the blanks in each of the following statements: 

a) PHP Scripts typically have the file extension_. 

b) The two numeric data types that PHP variables can store are _ and 


c) In PHP, uninitialized variables have the value_. 

d) _are divided into individual elements, each of which act like individual vari¬ 

ables. 

e) Function_returns the total number of elements in an array. 

f) To use Perl compatible regular expressions, use the_function. 

g) A_in a regular expression matches a predefined set of characters. 

h) PHP Stores ali global variables in array_. 

i) Function_terminates script execution. 

j) _maintain state information on a client’s computer. 

ANSWERS TO SELF-REVIEW EXERCISES 

29.1 a) True. b) False. Function names are not case sensitive, c) False. The strval function re¬ 
turns the converted value, but does not affect the original variable. d) True. e) True. f) True. g) False. 
The quantifier + matches one or more of the preceding pattems. h) False. Opening a file in write 
mode causes the file to be overwritten. i) False. Cookies are stored on the client’s computer, j) True. 

29.1 a) .php. b) integers, double. c) undef . d) Arrays. 

e) count. f) preg_match. g) character class. h) $GLOBALS. i) die. j) Cookies. 

EXERCISES 

29.3 Write a PHP program named States .php that creates a scalar value $ States with the 
value "Mississippi Alabama Texas Massachusetts Kansas". Write a program that 
does the following: 

a) Search for a word in scalar $states that ends in xas. Store this word in element 0 of 
an array named $statesArray. 

b) Search for a word in $states that begins with k and ends in s. Perform a case-insen- 
sitive comparison. Store this word in element 1 of $statesArray. 

c) Search for a word in $states that begins with M and ends in s. Store this element in 
element 2 of the array. 

d) Search for a word in $ States that ends in a. Store this word in element 3 of the array. 

e) Search for a word in $ States at the beginning of the string that starts with M. Store this 
word in element 4 of the array. 

f) Output the array $statesArray to the screen. 

29.4 In the text, we presented environment variables. Develop a program that determines whether 
the client is using Internet Explorer. If so, determine the version number and send that information 
back to the client. 

29.5 Modify the program in Fig. 29.14 to save information sent to the server into a text file. Each 
time a user submits a form, open the text file and print the file’s contents. 

29.6 Write a PHP program that tests whether an e-mail address is input correctly. Verify that the in- 
put begins with series of characters, followed by the @ character, another series of characters, a period 
(.) and a final series of characters. Test your program, using both valid and invalid email addresses. 

29.7 Using environment variables, write a program that logs the address (obtained with the 
REMOTE ADDR environment variable) requesting information from the Web server. 
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29.8 Write a PHP program that obtains a URL and a description of that URL from a user and Stores 
the information into a database using MySQL. The database should be named URLs, and the table 
should be named Urltable. The first field of the database, which is named URL, should contain an 
actual URL, and the second, which is named Description, should contain a description of that 
URL. Use www.deitel. com as the first URL, and input Cool site ! as its description. The sec¬ 
ond URL should be www.php .net, and the description should be The of f icial PHP site. Af- 
ter each new URL is submitted, print the complete results of the database in a table. 

WORKS CITED 

1. S.S. Bakken, et al., “Introduction to PHP,” 17 April 2000 <www.zend.com/zend/hof/ 
rasmus .php>, 

2. S.S. Bakken, et al., “A Brief History of PHP,” January 2001 <www.php.net/manual/en/ 
intro-history. php>.s 


(***SOLUTIONS** *) 


SELF-REVIEW EXERCISES 

29.1 State whether the following are true or false. If false, explain why. 

a) PHP code is embedded directly into XHTML. 

ANS: True. 

b) PHP function names are case sensitive. 

ANS: False. Function names are not case sensitive. 

c) The strval function permanently changes the type of a variable into a string. 

ANS : False. The strval function retums the converted value, but does not affect the orig- 
inal variable. 

d) Conversion between data types happens automatically when a variable is used in a con- 
text that requires a different data type. 

ANS : True. 

e) The f oreach loop is a control structure that is designed specifically for iterating over 
arrays. 

ANS: True. 

f) Relational operators can be used for alphabetic and numeric comparison. 

ANS: True. 

g) The quantifier +, when used in a regular expression, matches any number of the preced- 
ing pattem. 

ANS: False. The quantifier + matches one or more of the preceding patterns. 

h) Opening a file in append mode causes the file to be overwritten. 

ANS : False. Opening a file in write mode causes the file to be overwritten. 

i) Cookies are stored on the server computer. 

ANS : False. Cookies are stored on the client’s computer. 

j) The * arithmetic operator has higher precedence than the + operator. 

ANS : True. 

29.2 Fili in the blanks in each of the following statements: 

a) PHP Scripts typically have the file extension_. 

ANS: . php. 

b) The two numeric data types that PHP variables can store are _ and 
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ANS : integers, doubles. 

c) In PHP, uninitialized variables have the value_. 

ANS: undef. 

d) _are divided into individual elements, each of which act like individual vari¬ 

ables. 

ANS : Arrays. 

e) Function_returns the total number of elements in an array. 

ANS: count. 

f) To use Perl compatible regular expressions, use the_function. 

ANS: preg_match. 

g) A_in a regular expression matches a predefined set of characters. 

ANS : character class. 

h) PHP Stores ali global variables in array_. 

ANS: $GLOBALS. 

i) Function_terminates script execution. 

ANS: die. 

j) _maintain state information on a client’s computer. 

ANS : Cookies. 


EXERCISES 


29.3 Write a PHP program named States .php that creates a scalar value $ States with the 
value "Mississippi Alabama Texas Massachusetts Kansas". Write a program that 
does the foliowing: 

a) Search for a word in scalar $states that ends in xas. Store this word in element 0 of 
an array named $statesArray. 

b) Search for a word in $states that begins with k and ends in s. Perform a case-insen- 
sitive comparison. Store this word in element 1 of $statesArray. 

c) Search for a word in $states that begins with M and ends in s. Store this element in 
element 2 of the array. 

d) Search for a word in $ States that ends in a. Store this word in element 3 of the array. 

e) Search for a word in $ States at the beginning of the string that starts with M. Store this 
word in element 4 of the array. 

f) Output the array $statesArray to the screen. 

ANS: 


1 

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Trani 


2 

"http://www.w3.org/TR/xhtml1/DTD/xhtml1-1ransi 1 

:ional .dtd"> 

3 



4 

<!-- Exercise 29.3: ex29 03.php --> 


5 



6 

<html xmlns = "http://www.w3.org/1999/xhtml"> 


7 

<headxtitle>Exercise 29. 3</titlex/head> 


8 



9 

<body> 


10 

<?php 


11 

$states = 


12 


i 

13 



14 

if ( eregi( 

, $states. 

15 

$matches ) ) 
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16 

17 

$statesArray[ 

] = $matches[ 

1 ; 

18 

19 

if ( eregi( 

$matches ) ) 


, $states. 

20 

21 

$statesArray[ 

] = $matches[ 

1; 

22 

23 

if ( eregi( 

$matches ) ) 


, $states. 

24 

25 

$statesArray[ 

] = $matches[ 

1 ; 

26 

27 

if ( eregi( 

$matches ) ) 


, $states. 

28 

29 

$statesArray[ 

] = $matches[ 

1 ; 

30 

31 

if ( eregi( 

$matches ) ) 


, $states. 

32 

33 

$statesArray[ 

] = $matches[ 

1 ; 

34 

foreach ( $statesArray as $key => 

$value ) 

35 

36 

37 

38 

print ( 

?> 

</body> 

</html> 

); 




29.4 In the text, we presented environment variables. Develop a program that determines whether 
the client is using Internet Explorer. If so, determine the version number and send that information 
back to the client. 

ANS: 


1 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional/ /EN 

2 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-transitional.dtd''> 

3 

4 <! — Exercise 29.4: ex29_04.php --> 

5 <!-- Program to determine version number of IE --> 

6 

7 <html xmlns = "http://www.w3.org/1999/xhtml"> 

8 <headxtitle>Exercise 29 .4</titlex/head> 

9 

10 <body> 

11 < ?php 
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TZ 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 


( eregi( 

$HTTPUSER AGENT, $matches ) ) 

print ( 


else 

print ( 


?> 

</body> 
</html> 


. $matches[ ] ); 



29.5 Modify the program in Fig. 29.14 to save information sent to the server into a text file. Each 
time a user submits a form, open the text file and print the file’s contents. 

ANS: 


1 <!DOCTYPE html PUBLIC 

2 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-transitional.dtd"> 

3 

4 <!— Exercise 29.5: ex29_05.php --> 

5 <!— Program to save information to comma --> 

6 <!— delimited text file --> 

7 

8 <html xmlns = "http://www.w3.org/1999/xhtml"> 

9 <head> 

10 <title>Exercise 29.5</title> 

11 </head> 

12 

13 <body style = "font-family: arial,sans-serif "> 

14 

15 <?php 

16 

17 // determine if the phone number is valid and print 

18 //an error message if it is not 

19 if ( !ereg( , 

20 $phone ) ){ 

21 

print ( 

23 font-size 2em\"> 

24 INVALID PHONE NUMBER</span><br /> 

25 

26 <strong> (555) 555-5555</strongxbr /> 
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28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 
81 


); 


die(); // terminate script execution 

} 

// Write data to a text file 

if ( $file = fopen( , ) ) { 

fputs( 

$file, ); 

fclose ( $file ); 

} 

else 

print ( 


<p>Hi 

<span style = "color blue > 

<strong> 

<?php print ( ); ?> 

</strong> 

</span> . 

Thank you for completing the survey. <br /> 

You have been added to the 

<span style = "color blue"> 

<strong> 

<?php print ( ); ?> 

</strong> 

</span> 
mailing list. 

</p> 

<strong>The following information has been saved 
in our database: </strongxbr /> 


<table border = 
<tr> 

<td bgcolor 
<td bgcolor 
<td bgcolor 
<td bgcolor 
</tr> 


cellpadding = cellspacing 

>Name </td> 
Email</td> 

>Phone /td> 

>OS</td> 


<?php 

// open file 

if ( !( $file = fopen( 
) ) ) { 

print ( 


> 


die (); 


) ; 
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"52“ 

83 

84 

85 

86 

87 

88 

89 

90 

91 

92 

93 

94 

95 

96 

97 

98 

99 

100 
101 
102 

103 

104 

105 

106 

107 

108 

109 

110 
111 
112 

113 

114 

115 

116 


> 

// read each line in file 

while ( !feof( $file ) ) { 

// read line from file 

$line = fgets( $file, ); 

II remove newline character from end of line 

$line = chop( $line ); 

// split each value 

$field = split( , $line, ); 

// print text file data 
print ( 


) ; 


> 

II close text file 

fclose( $file ); 

?> 

</table> 

<br /xbr /xbr /> 

<div style = "font-size 

This is only a sample form. 

You have not been added to a mailing list. 

</div> 

</body> 

</html> 



1 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN 

2 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-transitional.dtd"> 

3 

4 <!— Exercise 29.5: ex29_05.html --> 

5 < ! — Form for use with ex29__05.php program --> 

6 

7 <html xmlns = ‘‘http://www.w3.org/1999/xhtml"> 

8 <head> 

<title>Sample form to take user input in XHTML /title> 

10 </head> 

11 

12 <body> 

13 

14 <hl>This is a sample registration form.</hl> 

15 <p>Please fili in all fields and click Register. </p> 

16 

17 <!— post form data to ex29_05.php --> 

18 <form method = pos action = 05 > 
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19 

<img src = 


ait = /xbr 

/> 

20 





21 

<span style = " 


r: blue > 


22 

Please fili 

out 

the fields below.<br /> 


23 

</span> 




24 





25 

<img src = "ima 


fname.gif ait = "First Name' 

/> 

26 

<input type = 


name = /xbr /> 


27 





28 

<img src = "ima 


lname.gif ait = "Last Name" 

/> 

29 

<input type = 


name = "lna /xbr /> 


30 





31 

<img src = "ima 


email.gif ait = "Email" /> 


32 

<input type = 


name = /xbr /> 


33 





34 

<img src = "ima 


phone.gif ait = "Phone /> 


35 

<input type = 


name = phom /xbr /> 


36 





37 

<span style = 


-size: 10pt"> 


38 

Must be in the form (555) 555-5555</span> 


39 

</span> 




40 

<br /xbr /> 




41 





42 

<img src = "ima 




43 

ait = "Publi 


/xbr /> 


44 





45 

<span style = 


r: blue > 


46 

Which book would 

you like information about? 


47 

</spanxbr /> 




48 





49 

<select name = 


k"> 


50 

<option>Internet 

and WWW How to Program 2e</option> 

51 

<option>C++ 

How 

to Program 3e</option> 


52 

<option>Java 

How 

to Program 4e</option> 


53 

coption XML 

How 

to Program le</option> 


54 

</select> 




55 

<br /xbr /> 




56 





57 

<img src = "ima 


os.gif" ait = "Operating Syst 

rem" /> 

58 

<br /xspan style = 

"color : blue" > 


59 

Which operating 

system are you currently using? 

60 

<br /x/span> 




61 





62 

<input type = 


name = "os" value = "Windc 


63 

checked = 


ec /> 


64 

Windows NT 




65 





66 

<input type = 


name = "os value = 


67 


0" /> 


68 

Windows 2000 




69 





70 

cinput type = 


name = "os" value = 


71 


/> 



72 

Windows 98<br /> 



73 
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"73 <input type = dio" name = "os" value = 

75 Linux 

76 

77 cinput type = "radio" name = "os" value = 

78 Other<br /> 

79 

80 <input type = value = /> 

81 </form> 

82 

83 </body> 

84 </html> 




1449 

7 > 

/> 
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29.6 Write a PHP program that tests whether an e-mail address is input correctly. Verify that the 
input begins with series of characters, followed by the @ character, another series of characters, a pe- 
riod (.) and a final series of characters. Test your program, using both valid and invalid email ad- 
dresses. 
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ANS: 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 


<!DOCTYPE html PUBLIC 


<!-- Exercise 29.6: ex29_06.php --> 

<html xmlns = "http://www.w3.org/1999/xhtml"> 

<headxtitle>Exercise 29 . 6</titlex/head> 
<body> 

<?php 

if ( isset( $email ) ) { 

if ( 

ereg( 

$email ) ) 

print ( 

else 

print ( 

} 

else { 
print ( 



} 

?> 

</body> 
</html> 


); 
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29.7 Using environment variables, write a program that logs the address (obtained with the 
REMOTE ADDR environment variable) requesting information from the Web server. 

ANS: 


1 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN 

2 "http://www.w3.org/TR/xhtmll/DTD/xhtmll-transitional.dtd"> 

3 

4 <!— Exercise 29.7: ex29_07.php --> 

5 

6 <html xmlns = "http://www.w3.org/1999/xhtml"> 

<headxtitle>Exercise 29. 7</titlex/head> 

8 

9 <body> 

10 

1 1 < ?php 

12 if ( $file = fopen( 

13 fputs( $file, 

14 fclose( $file ); 

15 print ( 


) ) { 

); 
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re ); 

17 } 

18 else 

19 print ( ); 

20 ?> 

21 

22 </body> 

23 </html> 



29.8 Write a PHP program that obtains a URL and a description of that URL from a user and Stores 
the information into a database using MySQL. The database should be named URLs, and the table 
should be named Urltable. The first field of the database, which is named URL, should contain an 
actual URL, and the second, which is named Description, should contain a description of that 
URL. Use www.deitel. com as the first URL, and input Cool site ! as its description. The sec¬ 
ond URL should be www.php .net, and the description should be The of f icial PHP site. Af- 
ter each new URL is submitted, print the complete results of the database in a table. 

ANS: 


1 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN 

2 "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitiona1.dtd"> 

3 

4 <!-- Exercise 29.8: ex29 08a.php --> 

5 

6 <html xmlns = "http://www.w3.org/1999/xhtml"> 

7 <head> 

8 <title>Exercise 29.8</title> 

9 

10 <style type = > 

11 

12 .blue { color: ; font-weight: } 

13 p { font-family: } 

14 

15 </style> 

16 </head> 

17 

18 <body> 

19 <strong> 

Please enter a URL and a description. 

21 </strong> 

22 

23 <form method = "post" action = x29 08b..php"> 
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24 

<span class = "blu > 


25 

URL 


26 

</spanxbr /> 


27 



28 

<input type = "text" nane = "site" size 

= "40" 

29 

value = http //" /xbr /xbr /> 


30 



31 

<span class = 'blue"> 


32 

Description of the URL 


33 

</spanxbr /> 


34 



35 

<input type = "text" nane = "descriptioi 


36 

size = 50" /xbr /xbr /> 


37 

<input type = value = 

/> 

38 

</form> 


39 

</body> 


40 

</html> 



1 

<!DOCTYPE html PUBLIC "-/ /W3C/ /DTD XHTML 1.0 Trai 


2 


Ltional.dtd"> 

3 



4 

<!— Exercise 29.8: ex29 08b.php --> 


5 



6 

<?php 


7 

if ( !( $database = mysql_connect ( 


8 

, , ) ) ) 


9 

die ( ); 


10 



11 

if ( !mysql_select_db( , $database ) 

i 

12 

die ( ); 


13 



14 

$query = 

7 

15 

$query . = 

7 

16 

if ( !( $result = mysql_query( $query, $database ) ) ) 

17 

{ 


18 

print ( 

); 

19 

die( mysql_error () ) ; 


20 

> 


21 

?> 


22 



23 

<html xmlns = "http://www.w3.org/1999/xhtml"> 


24 

<headxtitle>Database Update</titlex/head> 


25 



26 

<body> 


27 



28 

<hl>Database successfully updated. </hl> 


29 



30 

<table border = "1”> 


31 

<tr> 


32 

<th; URL :/thxth>Description</th> 


33 

</tr> 


34 

<?php 


35 

if ( !( $result = mysql_query( 

r 

36 

, $database ) ) ) 
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TT 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 


{ 

print ( ) 

die( mysql_error() ); 

> 


while ( $row = mysql_fetch_row( $result ) ) 
print ( . $row[ 0 ] . 

. $row[ 1 ] . ); 

?> 

</table> 

</body> 

</html> 
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